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FORCWORD 


The  Department  of  Defense  (DOD)  has  conducted  a  two-phase  study  to  determine 
how  scientists  and  engineers  in  government  and  industrial  research,  development  and 
production  activities  acquire  Information  for  performing  work  assignments  on  DOD 
programs.  This  study  is  referred  to  as  the  DOD  User-Needs  Study,  Phase  I  and 
Phase  II. 

Objectives  of  the  study  are  to  develop  (a)  an  understanding  of  the  scientific  and 
engineering  process  and  ‘‘s  technical  information  needs,  (b)  implications  for  curi'ent 
and  future  DOD  scientifi*.  .nd  engineering  information  systems,  and  (c)  information 
to  guide  administrative  decisions  on  the  scope  of  DOD  scientific  and  technical  infor¬ 
mation  programs. 

The  Phase  I  study  covered  the  information  needs  of  DOD  personnel  engaged  in 
research,  development,  test  and  evaluation  (KDT&E)  activities.  Results  of  this  study 
are  contained  in  Reference  1. 


Phase  II  investigated  the  nation's  defense  industry  to  determine  its  information 
needs,  and  the  flow  of  scientific  and  technical  information  (flow  process)  inherent  In 
satisfying  those  needs.  It  is  based  on  a  representative  sample  of  1500  individuals 
from  83  organizations  in  the  defense  industry. 

The  Phase  II  Final  Report  describes  the  results  of  Phase  II,  and  comp.ares 
them  witli  those  of  Phase  I.  It  Is  presented  in  three  volumes.  Volume  I  contains  a 
non  teclinical  summai'y  of  Phase  II,  including  guidelines  for  management  decisions 
and  recommendations  for  the  future.  Volume  II  describes  the  teclinical  approach, 
findings  and  recommendations  of  the  study.  Volume  III  presents  the  reduced  data, 
in  tlie  form  of  frequency  distributions  and  models  for  relationships  among  elements 
of  the  flow  process . 


Phase  II  was  performed  by  North  American  Aviation,  Inc. ,  under  Contract  DSA- 
7-16244,  awarded  by  the  Defense  Supply  Agency  and  fiuided  by  the  Advanced  Research 
Projects  Agency.  The  study  was  administered  by  Mr.  Walter  M.  Carlson,  Director 
of  Technical  Information  in  the  office  of  the  Director  of  Defense  Research  and  Engi- 
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Center  Survey  interviews  were  made  possible  by  the  coopei’atiou  of  the  National 
Security  Industrial  Association  and  the  participating  organizations  listed  in  Appendix  A. 
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1.  INTRODUCTION 


1.1  PURPOSE  AND  OBJECTIVES  OF  PHASE  11 


'I'he  principnl  technlcnl  of  Department  of  Defense  (DOD)  eoulractois  are 

re.senroh,  development  nnd  produelion  of  weapons  and  their  supporting  systems. 

Thuir  efforts  involve  searching  for  and  using  an  enormous  amount  of  scientific  and 
technical  information.  'This  store  of  information  is  continually  growing,  nccompnnieri 
by  an  inci’oasing  need  for  imiirovlng  tlic  process  of  acfiuiring  it. 


The  problem  In  the  design  of  Information  systems  is  to  channel  the  required 
information  to  interested  persons  as  efficiently  as  possible.  The  goal  is  to  provide 
the  right  Information  to  tlio  right  person,  In  the  riglu  form,  at  the  right  time.  A 
first  step  in  achieving  tlds  goal  is  to  define  the  user's  need  and  procedures  for 
acquiring  technical  information. 

The  Office  of  the  Diroctoi'  of  Defense  Research  and  Engineering  has  initiated 
a  h.vo-phuse  study  of  luser  ncod.s  to  determine  the  information  acquisition  patteriis 
within  the  defense  community,  A  prior  study  (DOD  User-Needs  .Study,  Phase  I) 
surveyed  tlicse  patterns  among  a  random  sample  of  research,  development,  test  and 
evaluation  (RD'T&E)  pe'  sonnel  of  tlie  Department  of  Defense. 


The  aim  of  the  present  Phase  n  study  is  to  perform  a  similar  survev  to  learn 
how  scientists  and  engineers  in  the  defense  industi'y  gatlier  .scientific  and  technical 
iaforniation.  Data  were  obtained  by  personal  Interviews  witli  a  representative  sample 
of  l-'500  from  a  population  of  appro.\imately  120,000  scientists,  engineers  nnd  tecli- 
nicnl  personnel.  'I'hese  personnel  were  employed  by  73  companies,  8  research 
institutes  and  2  universities  that  are  defense  contractors.  Each  interview  dealt  with 
a  specific  task  recently  completed  by  the  user,  and  his  experiences  relating 
to  the  need  for,  search  for,  nnd  acquisition  of  information  required  In  perfoi'ming 
tiic  task.  Data  were  also  collected  concerning  Uic  individual's  use  of  formal  tech¬ 
nical  information  centers  and  services,  and  on  his  background,  experience  and  work 
activity. 


Tim  major  study  objectives  were  to  answer  qu-estions  in  tlic  loHowing  a  reas: 


•  What  are  the  educational,  cxpcrienco  and  Job  characteristics  of  the  users 
of  scientific  and  technical  information  in  the  defense  industry? 

♦  What  is  the  nature  of  the  scientific  and  technical  tasks  within  Um  dcfen.se 
industry  ? 

«  What  chai'acteristics  docs  the  defense  industi'y  exhibit  iji  its  utilization 
of  technical  information  centers  and  sex'viccs? 


«  What  characterizes  Die  search  and  acquisition  process  in  the  defense 
industry  ? 


*  What  are  the  alguiflcant  factors  within  the  flow  of  scientific  and  technical 
information  (flow  process)  for  the  clefonse  Industry? 

#  What  are  tlte  differences  between  DOD  in-house  and  defense  Industry 
personnel  and  il^olr  needs  and  procedures  for  nctiulring  scientific 
and  technical  Information? 


The  study  concentrated  on  the  information  wanted  and  used  to  perform  specific 
tasks.  It  was  not  concerned  with  "current-awareness"  (l.o. ,  "liUentlonal  browsing" 
that  Is  not  task-oriented)  iniox'matlon  which  a  person  uses  to  maintuin  an  awnrenesp 
of  the  state  of  the  art,  to  educate  himself,  to  review  previously  known  ai'cas,  and  tr- 
Btimulnio  his  thinking. 

Many  investigations  have  been  performed,  and  much  has  been  written,  conrorn- 
Ing  the  flow  of  sclenlific  and  technical  information,  iijc  iendcncy,  however,  has 
been  to  e>camlne  only  small  portions  of  Llie  flow  process,  or  to  speculate  about  largo 
portions  of  the  flow  proce.ss  In  vague  genoraUtlcs.  Thciofore,  very  little  of  a  com¬ 
prehensive,  definitive  and  unifying  nature  actually  has  been  said  about  the  process. 
The  DOD  User-Needs  Study  is  the  first  attenxpt  to  obtain  data  on  a  largo  portion  of 
the  flow  process,  and  the  Phase  II  analysis  is  the  first  attempt  to  draw  definitive 
and  unifying  conclusions  from  these  data.  'Phis,  in  turn,  will  provide  the  first  com¬ 
prehensive  definition  of  the  informntion  I’ccjuirements  in  todaj 's  complex  array  of 
scientific  and  technical  endenvoi’s. 

1.2  THE  ANALYTICAL  APPROACH^ 


The  analytical  approach  used  In  Phase  II  Is  described  in  general  terms  in 
Section  4  of  this  volume.  It  will  suffice  here  to  observe  that.  In  addition  to  the  com¬ 
pilation  of  frequency  distributions  for  the  answers  to  a  question  or  a  pair  of  questions, 
the  qualitative  data  have  been  transformed  into  numerical  form.  This  transforma¬ 
tion  is  based  on  the  arrangement  of  question  responses  Into  an  Infoi'mativo  order, 
and  the  association  of  a  numerical  value  with  each  question  response.  Then  models 
are  specified  for  relationships  that  are  suspected  among  olcmonts  of  the  flow  process. 
Finally  tlie  models  are  estimated  from  the  data  by  means  of  regression  analysis,  to 
reveal  significant  relationships  and  factors  witliln  the  flow  process. 


Accomplishmcrits  of  t'<C  approach  iiichiuo; 


•  An  informative  structure  for  viewing  the  flow  process. 

•  A  quantitative  form  for  the  data,  to  cxpodilo  their  analysis. 

•  Models  for  significant  I'clatlonships  amoixg  elenxents  of  the  flow  process. 

•  Significant  factoi's  within  the  flow  process. 

«  A  basi.s  for  future  investigations. 


Tlieso  acconiplislnnents  pervade  tlie  Final  Hopoin.  They  enable  it  to  present  compre¬ 
hensive,  definitive  and  unifying  descriptions  and  conclusions  regarding  lai'ge  portions 
of  the  flow'  process. 

^This  analysis  is  respectfully  dedicated  to  the  memory  of  Dr.  Fditii  Jay,  wliosc  ideas 
servo  as  an  inspiration  to  all  of  us.  The  great  contribution  wliicli  she  always  brouglit 
to  a  ixrojoct  was  prevented  by  her  untlnxely  passing. 

f> 


The  approfieli  is  bcllovod  to  be  novel  In  Uie  field  of  information  aelooce,  im 
employmont  nnd  leating  tn  Phnso  II  have  yielded  results  Uiut  arc  oneouiayiiiji,  and 
implications  for  tho  future  Dml  arc  provocative. 

1.3  OHGANIZATION  OP  VOLUME  I 


This  volume  is  organized  so  that  the  render  eon  get  the  oBsonce  of  the  studj’  by 
rending  Sections  1,  2  and  ;t,  SecUons  -1  and  .n  present  complenionlary  information 
which  will  help  tlte  reader  understand  tho  fli’at  three  sections  in  a  broader  context. 
More  detailed  findings  ore  contained  in  the  Appendices. 

Section  2  presents  some  conclusions  in  the  fonn  of  guidelines  for  managers  and 
others  concernecl  with  tho  DOD  scientific  nnd  technical  information  systems.  Those 
guidelines,  which  represent  the  major  implications  of  the  study,  will  sorvo  to  guide 
ninnugomenl  decisions  on  tho  dirootlon  and  scope  of  tlie  DOD  Scientific  and  Technical 
iiUormntion  Program,  nnd  the  i’cchnJcal  Logistics  Data  and  Information  Pi'ogram. 

Section  3  contains  recommondntions  fo)'  the  future  whlcii  ui'o  thought  to  be  most 
useful  In  continuing  the  progress  begun  by  the  DOD  Uscr-Noeds  Study.  These  recom.. 
nicndatlons  arc  of  three  typos: 

♦  Additional  field  cxpeiimenUition  regarding  the  flow  process. 

♦  A  program  for  analysis  and  optimization  of  tlie  flow  process.^ 

♦  Refined  niinlysls  of  the  data  from  the  Phase  I  and  Phase  11  studies, 

Section  -1  doocribos  in  general  terms  the  moUiodology  used  In  preparation  for, 
conduct  of,  and  analysis  of  tho  survey.  It  also  discusses  tiie  modification  of  the 
Interview  Guido.  Piimlly,  Section  rj  discusses  tho  background  for  interpreting  tho 
study  and  its  rosulls,  to  ensure  the  proper  use  of  this  report. 

Appendix  A  lists  the  organizations  participating  In  Phase  11.  A  comparison  of 
the  Phase  I  and  Phase  II  .studios  is  presented  In  AppendLx  B.  Tho  basic  findings  of 
the  Phase  U  study  age  cummnrized  in  Appendix  C.  These  findings  are  focused  on 
tho  (a)  soni'ch  and  acquisition  process,  (b)  utilization  of  information  centers  nnd 
services,  (c)  sciontlflc  or  technical  task,  (d)  user  of  scientific  nnd  tcchnlonl  informa- 
iioii,  niKi  (e)  .significant  tactors  within  the  flovv  proee.sB. 


9 

■■  'J'hc  flow  process  is  optimized  when  Us  effect  upon  the  performance  of  a  scientific 
or  technical  task  is  optimized. 
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2.  CONCLUSIONS 


The  majoi'  roncliisloiis  of  Ihc  tJlLtciy  can  be  c.\|)ie.sfierl  in  the  form  of  jfutdellnoa 
for  ronnttRcmonl  (leelHions  IjeiiriiiK  on  tlm  dlrt-cflon  and  acopo  of  Ilod  information 
pronramB,  ThoHP  RUklolinoH  are  supported  by  the  numerlenl  findings  which  are 
Hummnrlj'od  in  Appoiullces  13  and  C,  espocfnlly  those  tn  Fif^iro  C-*12,  and  preaented 
I'l  detntl  In  Volume  II.  The  two  surveys  protlucod  a  <'Oii.s(denil)'.t*  muss  of  data  con¬ 
cerning  the  scientific  and  leehnical  process  and  its  infurmation  needs.  It  is  likely 
that  additional  annlvsls  In  depth  may  yield  furllter  information  about  the  usor'a  needs 
and  the  flow  process  llmt  would  permit  refinemonts  and  adrlition,'?  to  the  prcK<'nt 
guidelines. 


2.1  iMPOirrANCb  OF  CFiri'AlN  CATFUOHIES*’  OF  INFOHMATION 


Priority  of  effort  should  be  assigned  to  liiformalie"'  which  is: 

•  In  tlie  development  phti.se  of  (he  rc.seareh.  cievclopment  and  prodiieiion 
cycle. 

♦  Helnted  to  design  and  performance. 

*  In  the  engineering  field. 

The  onginoering  subfields  that  aro  of  groalest  Interest  are  electronics  and 
electrical  engineering,  ojid  aoronautica  and  space  technology. 

2.2  IMPORTANCE  OF  THE  LOCAL  WORK  EmTRONMENT  AS  A  SOURCE  FOR 
INFORMATION-' 


Eighty  percent  of  the  (itne,  the  Plmse  II  users  first  searched  for  Itiformatlon 
within  the  local  work  environment.  Therefore,  Information  policies  Siiould  recognize 
and  seek  to  strengthen  the  uUlity  of  local  sources  of  scientific  and  technicnl  lafor- 
mation.  Specifically,  mure  effort  should  be  devoted  to: 

•  Orgnnl/ed  storage  and  active  circulation  to  the  local  work  environment 
of  Information  which  Is  informal  or  somlfornial  in  composition. 

•  'railoring  for  il>e  local  work  environment  the  liide.\ing,  ubstracUag, 
organization  and  anal,vsi.s  of  Information,  i>riov  to  its  distribution. 

•  Selective  and  automatic  dissemination  to  the  local  work  envlronmorit  of 
these  tailored  liule.xes,  abstracts,  and  organized  and  analyzed  information. 

Parli.ally  organized  and  analyzed  {"once-over-llghtly")  information  is  of  quos- 
tionnblo  value,  since  it  snti.srics  only  a  small  poi’centage  of  information  needs  in 
task-oriented  situations. 


I  The  categories  arc  defined  in  the  introduction  to  Appendix  B. 

The  "local  work  environment"  extends  only  as  far  from  th.e  user  ns  an  internal 
company  consultant,  but  not  ua  far  ns  the  company  Technical  Information  Center, 
which  is  his  comiection  witli  the  formal  information  sy.stcm  {sec  'i'able  -1-2), 


2 . 3  PUBLICITY  CONCERNING  DOD  INFORMATION  CENTERS  AND  SERVICES 


More  effort  should  be  devoted  to  publicity  pi'ograms  for  informing  the  scientific 
and  technical  community,  especially  within  the  defense  industry,  regarding  the 
availability  of  DOD  Information  Centers  and  Seiwices  and  the  procedures  for  their 
most  efficient  use , 

2.4  SATISFYING  THE  NEEDS  OF  THE  SIGNIFICANT  USERS  OF  INFORMATION 

More  effort  should  be  devoted  to  satisfying  the  needs,  and  minimizing  the  infor¬ 
mation  acquisition  problems,  of  the  significant  users  of  scientific  and  technical 
infonnation.  In  general,  these  users  are  characterized  by  their  value  to  the  company: 
that  is,  they  are  research  and  development  scientists  or  engineers  who  have  an 
advanced  degree,  are  specialists  or  in  lower  management  levels,  and  are  highly  paid. 
These  pei'sonnel  are  also  the  real  users  of  information  centers  and  services  and  the 
ones  most  frustrated  by  problems  involving  their  use. 

2.5  INPUT/OUTPUT  RELATIONS  FOR  THE  FLOW  PROCESS 


The  major  components  of  the  flow  process  are  the  (a)  USER  of  scientific  and 
technical  information,  (b)  scientific  or  technical  TASK,  (c)  UTILIZATION  of  informa¬ 
tion  centers  and  services,  and  (d)  SEARCH  AND  ACQUISITION  process.  From  a 
systems  design  point  of  view,  it  is  informative  to  consider  (see  Figui*e  2-t): 

*  The  primary  "input/output"  relation  (symbolized  by  arrow  1)  with  USER 
and  TASK  as  "inputs”  (i.e. ,  tending  to  influence)  and  UTILIZATION  and 
SEARCH  AND  ACQUISITION  as  "outputs"  (i.e.,  tending  to  be  influenced). 

•  A  secondary  input/output  relation  (symbolized  by  arrow  2)  with  USER  as 
input  and  TASK  as  output. 

-  •  A  secondary  input/output  I'elation  (symboazed  by  arrow  3)  with  USER  as 

input  and  UTILIZATION  as  output. 


A  seco  ndsi'y  inp”t/ Ovi  tput  relation  (symbolized  by  the  arrows  marked  4) 
with  USER,  TASK  and  UTILIZATION  as  inputs  and  SEARCH  AND 
ACQUISITION  as  output. 


2.6  SIGNIFICANT  RELATIONSHIPS  WITHIN  THE  FLOW  PROCESS 


The  analysis  characterized  i-elationships  among  elements  of  the  flow  process. 
These  relationships  should  be  utilized  in  the  planning  and  operation  of  scientific  and 
technical  information  progi’ams.  Among  the  more  significant  relationships  are: 

•  The  higher  the  user's  level  and  value  to  his  organization,  the  more 
complex  the  task  and  its  information  requii'ements. 

«  Greater  complexity  of  the  task  occurs  earlier  in  the  research,  development 
and  production  cycle.  In  the  earlier  phases  of  the  cycle,  information  is 
needed  in  greater  formality  and  detail;  and  it  takes  longer  to  acquire  this 
information. 


•  As  the  formality  of  the  task  output  increases  (i.e. ,  from  findings  through 
decisions  to  plans),  the  complexiti'  of  the  information  tends  to  increase. 

•  When  more  time  is  available  for  a  task  and  for  the  acquisition  of  informa¬ 
tion,  the  user  tends  to  be  more  demanding  in  regard  to  the  organization 
of  the  media  conveying  the  information  and  the  volume  of  information 
I’equired. 

•  Those  who  tend  to  make  more  use  of  information  centers  and  services, 
want  more  fox’mality  and  detail  in  the  information  media  to  satisfy  their 
needs. 

•  When  the  user  goes  to  a  more  distant  first  source  (e.  g. ,  formal  informa¬ 
tion  centei’s)  the  information  requested  will  involve  more  formal  media,  in 
greater  volume  and  accompanied  by  a  greater  allowable  acquisition  time. 
On  the  other  hand  the  more  distant  first  source  tends  to  yield  only  part  of 
the  needed  information,  so  that  further  search  is  required. 
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2 . 7  COMPARISON  OF  PHASKS  I  AND  U 

The  five  general  conclusions  of  Phase  I  are: 

•  Engineering  data  is  the  most  important  category  of  information. 

•  The  local  work  environment  is  the  most  important  first  source  for 
ii\forniation. 

»  Information  analysis  prior  to  distribution  is  important  in  a  scientific  and 
technical  information  pi’ogram. 

•  The  DOD  Information  Centers  and  Services  are  not  sufficiently  used. 

•  The  user  is  not  completely  satisfied  witli  his  ability  to  obtain  information. 

Although,  answers  to  comparable  questions  in  Phases  I  and  II  exhibit  significant  differ¬ 
ences  (see  Appendix  B),  the  Phase  II  data  sustain  these  conclusions  (see  Sections  2.1 
through  2.4). 

2 . 8  CONTINUING  STUDY  AND  ANALYSIS 

More  effort  should  be  devoted  to  the  extension  of  progress  made  by  the  DOD 
User-Needs  Study,  as  described  in  the  following  section. 
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3*  RECOMMENDATIONS 


The  two  surveys  of  user  needs  within  the  Government  and  defense  industry 
environments  have  yielded  a  wealth  of  valuable  data  relating  to  the  scientific  and 
technical  information  flow  process.  The  analysis  of  these  data,  notwithstanding  cost 
and  schedule  limitations  inhei'ent  in  an  exploratory  research  project,  has  resulted  in 
useful  but  preliminary  insights  into  and  explanations  of  tlio  flow  process.  However, 
there  are  abundant  lodes  of  information  yet  to  be  discovered,  mined  and  refined,  in 
order  to  exploit  more  fully  the  economic  value  of  the  available  data  base.® 

The  Phase  II  study  was  a  pioi^eering  attempt  to  draw  comprehensive,  definitive 
and  unifying  conclusions  from  data  on  a  large  portion  of  the  flow  process.  From  the 
perspective  gained  in  this  study,  it  is  clear  that  certain  portions  of  the  flow  process 
merit  further  investigation  and  tliat  there  is  considerable  room  for  refinement  and 
extension  of  the  analysis.  A  more  detailed  discussion  of  the  recommendations 
contained  here  will  be  found  in  Volume  II. 

The  present  study  has  provided  a  valuable  basis  for  this  further  investigation 
and  refinement.  In  addition  to  yielding  gfuidelines  for  management  decisions,  it  has 
also  provided: 

•  A  structure  and  its  numerical  description  with  which  to  view,  specify 
and  estimate  models  describing  the  information  flow  pi'ocess, 

•  A  framev.'ork  for  designing  field  experiments,  perfor-ming  estimation  and 
testing  hjTJOtheses  concerning  the  flow  process. 

•  A  methodology  for  overcoming  the  analytic  deficiencies  in  past  and 
present  user  needs  studies®  by  the  development  of  a  structure, 
accomplishment  of  its  numerical  description,  and  specification  and 
estimation  of  multivariate  models  describing  the  flow  process. 

•  A  basis  for  the  recommendations  which  follow  concerning  (a)  additional 
field  experimentation  regarding  the  flow  process;  (b)  a  program  for 
coordinating  additional  field  expei'imentation  and  computer  simulation 

in  the  analysis  and  optimization  of  the  flow  process  (as  previously  noted, 
the  flow  proces.s  is  optimized  when  its  effect  upon  the  performance  of  the 
scientific  and  technical  tasks  is  optimized);  and  (c)  refined  analysis  of  the 
data  from  the  Phase  I  and  Phase  II  studies. 


®Since  the  discovery  and  exploitation  of  this  information  content  is  subject  to  the  law 
of  diminishing  returns,  the  recommendations  in  the  entire  section  are  goals  wid 
should  be  assigned  priorities  according  to  the  twin  criteria  of  objectives  and 
available  resources. 

®Noted  by  H.  Menzel  in  Chapter  3  of  Reference  2,  and  by  B.  Griffith  and  W.  Paisley 
during  the  Progress  Review  Panel  on  Infoi'mation  Needs  and  Uses  at  the  29th  Annual 
Meeting  of  the  American  Documentation  Institute,  October  3-7,  1966. 
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3. 1  ADDITIONAL  FIELD  EXPERIMENTATION 


In  order  that  the  implications  of  Phase  II  be  fully  exploited,  the  flow  process 
merits  further  investigation.  There  should  be  additional  field  observation,  experi¬ 
mentation  aJid  analysis  regarding  the  flow  process,  such  s: 

♦  An  investigation  of  the  feasibility  and  effect  upon  the  flow  process  of  the 
guidelines  in  Section  2. 

♦  An  investigation  of  task-oriented  use  of  information  centers  and  services. 

•  Experiments,  suggested  in  Reference  3,  concerning  (a)  dissemination  of 
documents;  (b)  dissemination  of  scientific  and  technical  intelligence 
information  (i.e. ,  what  is  going  on);  (c)  organization  and  analysis  of 
information  in  selected  fields;  (d)  indexes,  title  listings,  abstracts  and 
catalogues  in  selected  fields;  (e)  Specialized  Technical  Information 
Centers;  (f)  techniques  for  processing  informat!on;  and  (g)  evaluation  and 
impx'ovement  of  technical  writing. 

•  Specific  expei'iments  suggested  by  refined  analysis  of  the  data  (see 
Section  3*  3). 

3.  2  A  PROGRAM  FOR  ANALYSIS  AND  OPTIMIZATION 

The  flow  of  scientific  and  technical  iitformation  has  a  profound,  but  as  yet 
unchar acterized,  effect  upon  tlie  performance  of  scientific  and  technical  tasks.  In 
their  efforts  to  improve  task  pei’formance,  both  DOD  and  its  contractors  have  made 
lax'ge  investments  in  inforniaiion  centers  and  services.  Optimization  of  the  flow 
process  will  produce  substantial  benefits  in  terms  of  quality,  resources  and  time. 

The  flow  process  and  its  effect  upon  task  performance  are  quite  complex,  and 
field  experimentation  regarding  them  is  bot!\  difficult  and  expensive.  For  such 
processes,  mathematical  solution  is  usually  not  feasible  and  computer  simulation 
is  often  an  effective  and  efficient  means  to  complement  field  experimentation. 

When  the  model  (mathematical  representation)  for  the  process  is  translated 
into  a  simulation  computer  program  (computer  representation)  for  the  process,  the 
process  and  the  effects  of  various  factors  upon  it  may  be  simulated.  The  accuracy 
and  precision  of  the  compute)'  simulation  increase  as  the  accuracy  and  precision  of 
the  model  increase.  Therefore,  computer  simulation  yields  appropriate  results  at 
any  stage  of  one's  knowledge  about  a  proces,s,  I'anging  from  relative  ignorance  to 
relative  certainty. 

Specific  recommendations  for  additional  experimentation  have  already  been 
given.  We  now  briefly  describe  a  general  program  to  coordinate  field  experimenta¬ 
tion  and  computer  simulation  in  the  analysis  and  optimization  of  the  flow  process. 
This  program  (see  Figure  3-1)  is  an  improvement  of  one  which  was  developed  by 
North  American  Aviation,  Inc. ,  and  is  currently  being  utilized  by  a  Government 
Agency  on  a  process  of  comparable  complexity.  A  more  complete  treatment  of  the 
program  will  be  found  in  Volume  li. 
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Figure  3-1.  Program  for  Analysis  and  Optimization 


The  program,  which  is  adaptive  in  nature,  is  composed  of  ten  basic  stages; 

1.  Quantitative  process  analysis  to  arrange  tlie  elements  of  the  process  into 
an  informative  order;  associate  a  numerical  value  with  each  element;  and 
formulate  the  general  form  of  a  process  model,  for  relationships  among 
the  process  elements,  with  imspecifiod  constants. 

2.  Process  (field)  experimental  trial{s)  to  yield  process  experimental 
data. 

3.  Process  model  estimation  to  produce  estimates  of  unspecified  constants 
in  the  general  form  of  the  process  model  from  process  experimental  data 
and  auxiliary  data,  when  available. 

4.  Proces  p'  nulation  programming  to  construct  a  process  simulation 
computei  program  from  the  process  model. 

5.  Process  simulation  trial(s)  to  yield  process  simulation  data. 

6.  Process  model  and  simulation  data  comparison  to  provide  a  validation 
(i,  e. ,  positive  check)  for  the  process  simulation  computer  program. 

7.  Process  experimental  and  simulation  data  comparison  to  provide  a 
validation  for  the  combination  of  process  model  and  simulation  computer 
program. 

8.  Process  experimental  and  simulation  data  analysis  to  aid  process 
optimization  by  suggesting  improvement  of  the  process. 

9.  Process  optimization  to  iteratively  improve  the  process  and  apply 
appropriate  stages  of  the  program  to  the  improved  process. 

10.  Design  of  proce.$s  experimental  and  simulation  trials  to  implement 
process  optimization. 


Additional  experimentation  is 


VV/V  Kjy 


7  ooncorn  computer  simulation  ai^d  its  validation, 
and  optimization  of  the  flow  process  are  treated. 


Stages  4  through 
In  Stages  8  through  10,  analysis 


>  Alik 

tut  Ot 


The  recommendations  stated  here  provide  the  basis  ai'id  framework  for  a  long¬ 
term  investigation  and  improvement  of  the  flow  process. 


3.  3  REFINED  ANALYfllS  OF  THE  DATA 


Since  only  a  small  fraction  of  the  effort  expended  in  collecting  data  is  typically 
devoted  to  Its  analysis,  a  large  amovint  of  the  information  it  contains  generally  is 
undiscovered  and  unexploited. 
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A  more  profound  lUKlerstanding  of  the  DOD/defense  Industry  information  flow 
process  cmi  be  achieved  througii  more  refined  analysis  of  the  data,  as  suggostod 
below: 

♦  More  thorougii  exaniination  of  the  distribution  of  answers  to  questions  and 
their  relationships. 

♦  luvestigatlon  into  the  effect  of  company  size,  industry  and  interviewer 
bias  on  the  answers  to  questions. 

♦  Improvement  in  tlic  arrangement  of  responses  to  a  question,  and  the 
association  of  a  numorioal  value  with  each  response  to  a  question, 

♦  Reformulation  mid  ro-estlmatlon  of  appropriate  models  In  order  to  reflect 
the  above  improvements,  and  to  investigate  moi'C  specific  relationships 
which  involve  only  single  questions  (rather  than  combinations  of  related 
questions). 

♦  For  purposes  such  as  the  study  of  the  selective  dissemination  process, 
formulation  of  reverse  models  to  study  the  flow  process  in  reverse  (i.  e. , 
reverse  the  input/ouiput  relations  described  in  Section  2.  5  and  Appendix  C) . 
An  example  would  be  a  model  relating  the  user's  highest  degree  to  the 
class  of  infoiination,  desired  composition  and  layout  of  the  conveying 
media,  the  first  source  for  the  Information,  and  the  usefulness  of  title 
listings  and  abstracts. 

♦  Formulation  and  estimation  of  additional  models  describing  the  flow 
process,  and  utilization  of  additional  analytical  teclmlques  (such  as  factor 
analysis). 

♦  Division  of  the  sample  of  1500  users  into  appropriate  subsamples  to  permit 
analysis  and  comparison  of  special  groups,  such  as  the  throe  groups  that 
acquired  information  that  is  (a)  conceptual,  (b)  design  and  performance, 
and  (c)  production. 

9  /vppaoation,  as  appropriate,  of  the  above  suggestions  in  making  further 
analyses  of  the  Pliaso  I  data,  the  similai'ities  and  difforonces  of  the 
Phase  I  and  Phase  II  data,  and  the  combined  data  from  Phase  I  and 
Phase  II. 
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4.  METHOtOLOGY 


The  methodology  employed  In  the  study  of  the  dofonac  industry  (Phase  11)  was 
bused  on  procedonts  established  In  the  prior  Phase  1  Ktudy  of  DOD  personnel  engaged 
in  RDT&E.  Imp  rove  in  on  is  in  mothodology  wore  acluevcd  by  pi’ofltlng  from  lessons 
learned  in  the  Phase  I  sludy,  and  (lirough  the  use  of  a  more  eomprchcnslvc  and 
powerful  analytical  apiiroach.  Also,  iho  Intorvlow  Guido  used  in  Phase  I  was 
ttUlored  and  Improved  to  malto  it  more  suitable  for  use  in  u  survey  of  dofonse 
Indualry  laccls, 

■1.  1  PREPARATION  FOR  INTERVIEWS 

The  initial  portion  of  (ho  study  required  (a)  modifiealion  of  tho  Interviow  Guide, 
(b)  preparation  of  an  Interview  Guide  Handbook  and  Referoneu  Manual  for  use  by  the 
intoi'Vtowers,  (c)  tosting  of  (he  modified  Interviow  Guido  lo  validate  revisions  and 
provide  a  basis  for  further  improvements,  and  (tl)  seleetion  unci  training  of  the 
interviewers. 


Modification  of  Intorview  Guide 


The  Phase  I  Interview  Guide  had  to  be  modifird  In  two  major  areas: 

(a)  tailoring  to  the  defense  industry  population;  and  (b)  overall  improvoment  based 
on  Pliaso  1  experience.  North  American  Aviation  lochnlcal  evaluation,  and  tlio  pilot 
lest,  Modificutioas  wore  designed  to: 


«  Reorganize  it,  by  removing  extensive  tables  and  Including  them  in  a 
separate  Interview  Reference  Manual. 

•  Improve  the  printing  and  layout,  making  It  easier  to  record  data  during 
interviews. 

•  Provide  increased  logical  order  of  questions. 

•  Minimize  the  number  of  quosllous  (e.g. ,  by  lotting  one  group  of  related 
quGKtions  cover  entire  subject,  when  possible). 

•  Assess  the  utilization  of  company  TochniOal  Information  Coulors. 

•  A.sses.$  the  utilization  of  Non- DOD  Specialized  Information  Centors. 

•  luvostigate  I'ostriotions  on  availability  of  tcclnUcal  information. 

•  Provide  for  nuitally  exclusive  I'csponscs. 

•  E.xpand,  reorient  and  rearrange  question  responses, 

Tl:o  revi.sed  interview  Guide  contained  6,'3  questions,  grouped  accorcUag  to 
(a)  the  user  of  i^^formutiun,  (b)  his  most  recent  scientific  or  technical  task,  (c)  his 
utilization  of  information  centors  and  services,  imd  (d)  his  search  for  and  acquisition 
of  information  specifically  related  to  the  task.  Most  of  tlio  responses  to  questions 
in  tlie  Interview  Guide  are  qualitative  and,  (Imrofcrc,  not  su.sccptible  to  quantitative 
interpretation  without  using  special  lechnjquc.s. 
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i.ntorvlew  Guido  Handbook  aiid  lutorvlew  Reft; rcncc  Manual 


Th«  liiiterviovv  Oulde  Handbook  (Hoforoneo  4)  is  tho  basic  doenmontation  for  tho 
liilttal  portion  of  the  Phase  11  study.  It  contains  an  e.'<planatioa  of  and  Instruetlon  in 
the  IntcindGwing  methods,  quostlons  to  bo  oovorod  and  aids  for  tho  Intorviewora.  In 
developing  this  Handbook,  tho  primary  thome  wjis  to  tailor  It  to  servo  both  as  a 
training  dociunont  on  tho  objoolivoa  and  conduct  of  tho  study  luid  as  an  intorviovvor 
reforenco,  Tho  Hiuidbook  also  contains  tlio  basic  study  corrospondonco,  a  dlrootory 
of  poi’ticlpating  organizations  and  a  glossary  of  terms. 

An  innovation  In  Ph.aso  11  wos  tlio  Introduction  of  an  Interview  Roforonco 
Manual.  TlUs  Moituol  ootUolns  a  compact,  easily- handled  listing  of  frequently  used 
and  complex  responses  for  questions  In  tho  Interview  Guide.  Tlio  document  was 
basically  an  interviewer  aid,  and  was  .sln)wn  to  ilio  respondent  when  It  would 
facilitate  the  interview.  Inaiructlone  In  tho  use  of  the  Interview  Reference  Manual 
are  contained  In  the  Interview  Guide  Handbook. 


Pilot  Teat 

A  modified  Interview  Guide  was  pilot  tested  to  validate  the  revisions  accom- 
plishod  for  the  Phase  II  study.  As  specified  by  DOD,  tlie  pilot  testing  was  based  on 
20  intorvlewB  with  selected  engineering  and  scientific  personnel  of  North  American 
Aviation,  luc.  The  pilot  tost  resulted  in  a  I'oorganlzatlon  of  the  questions  Into  a 
more  logical  sequence. 

Selection  and  Trainiiitf  of  Interviewers 

Interviewers  were  selected  on  the  basis  of  their  scientific  and  technical  back¬ 
grounds,  research  experience,  interviewing  and  survey  experience,  maturity, 
personality  and  rosponelblllty.  All  interviewers  had  at  least  a  bachelor's  degree 
and  prior  Interviewing  experience.  Tho  interviewing  staff  employed  In  the  Phase  II 
kuvvoy  included  eight  behavioral  scientists,  throe  operations  research  analysts  and 
throe  information  processing  specialists. 


Each  interviewer  was  given  a  two-week  training  px'ogram,  consisting  of  class¬ 
room  Instruction  and  controlled  fiold  practice  intorvlows.  Training  emphasized 
olandardlzaiion  of  survey  inlorvLow  tcclmiquoa  in  douling  wiih  a  higiily  diversified 
sample.  Training  sessions  Included  Program  Orientation,  Scientific  and  Technical 
Information  Systems,  Survey  Operations,  Roview  of  Phase  1  Results,  Coniprohouslvo 
Study  of  the  Interview  Guido,  Summary  of  tlie  Analysis  Plan,  Interview  Demonstra¬ 
tion,  and  four  days  of  practice  interview.s  witli  critiques  of  student  performance. 
Remedial  sessions  were  scheduled  when  the  need  for  them  was  Indicated  during  the 
practice  interviews. 


Selection  of  Sample  for  the  Interviews 

Tho  National  Security  Industrial  Association  and  the  Director  of  Technical 
Information  in  the  Office  of  the  Director  of  Defense  Research  and  Engineering 
conlacled  and  obtamed  voluntary  participation  of  tlie  majority  of  organizations 
cooperating  in  the  survey.  North  Atncricun  Aviation,  Inc.  helped  ai'range  for  tho 
pai'ticipation  of  additional  qualifying  organizations,  Tito  organizations  surveyed 
included  M  of  tlie  top  25  DOD  contractors  and  17  of  tho  top  25  RDT&E  contractors. 
They  ai'O  considered  representative  of  the  major  DOD/RDT&E  contractors.  Appendix 
A  lists  participating  organizations  with  tho  sample  sizes  drawn  from  each. 


’rh«'  nii'Gctor  of  Technical  information  ijroviJud  oxplirit  instructioiia  On  tho 
niolhod  (o  be  employed  by  the  j>ai  ticipQtinK  oi'Jtaiilsitttlons  In  BoiocHng  the  snmples  of 
IndlvidualB  foi'  liUerview.  Tliy  samplo  for  Interview  woa  obtained  liy  tho  soioctlon 
of  a  representallvo  groiii)  of  1500  from  a  population  of  approximately  120,000 
ooiontlsts,  engineers  and  technical  porsonnol.  TliGse  peraonnel  worn  omployod  by 
73  companies,  8  roscarclt  InKtilutee  and  2  universities  having  dofonse  contracts. 

In  addition,  the  sequondal  acciulallion  of  data  poi  mitted  strong  poslttve  checks  to  bo 
made  upon  the  internal  conaistcncy  and  repreaontatlvo  nature  of  the  sample,  The 
Individuals  saniplod  roproKcnl  approKlmately  l.G  percent  of  the  total  scientific, 
pnglnocring  and  technical  poreonnol  of  tho  k:i  purticipaling  organlzatlonH. 

Pre-Survey  Preparation  of  tl>o  Intervtewoes 

Early  in  Uio  pltuming  of  survey  operations,  it  was  delerniinod  Mud  tho  conduct 
of  llic  survey  and  the  quality  of  responses  would  bo  enhanced  considerably  if  Inter- 
vlowGGS  wore  famllla»‘  wili^  (l»o  purpose  of  the  study  and  tho  kinds  of  questions  to  be 
uskod.  Consequently  a  dGScrlptlvc  brocliurc,  Synopsis  of  Interview  Topics  (an 
Appendix  to  Volume  II),  was  dovolopod  juid  distributcfl  to  oach  inlorviewce  in  advance 
of  tlie  interview. 

Tills  brochures  acquainlod  the  interviewees  with  the  topics  to  bo  discussed.  It 
provided  aframo  of  reference,  introduced  the  general  subject  matter  of  the  inlor- 
view,  oncl  tended  to  ease  possible  confu.slon  and  approhonslom  The  Synopsis  also 
reassured  tlie  interviewee's  managomont  that  the  aurvey  was  solely  Intended  to 
Investigate  Information  noecls  and  acquisition  procedures,  and  that  it  was  act  an 
allompt  to  obtoi’i  olaaslficd  or  proprietary  information.  Commont  from  the  Intorvlow 
staff  indicated  tival  Uio  Synopsis  fulfilled  its  Intended  purposos. 

Intorviow  Poticy 

The  sample  to  be  intoiwlewed  spanned  a  diversity  of  backgrounds  (o.  g. ,  field 
of  training  and  extent  of  formal  education)  and  position  levels  (c.g. ,  typo  of 
activity  and  level  of  responsibility).  In  addition,  the  ilow  of  sclontific  and  teclmical 
information  is  not  widely  discussed  or  understood.  It  was,  thereforo,  realized 
that  tile  interview  questions  might  have  different  meanings  to  different  lutorviewoes. 

In  orciev  to  acliievc  coinpaiabio  rOfiidts  under  ilie.se  conditions,  the  interview 
was  "sliindardi7.od"  so  that  essentially  tho  same  Information  would  bo  collected  from 
each  fnlevviewee.  Tills  was  achieved  by  the  interviewer  tailoring  tiio  formulation 
and  sequence  of  the  questions  to  each  intorvioweo  (i.  o. ,  "non-sclieduled"  intor- 
viewing).  Tho  interview  was  predominantly  one  of  "free  rcspon.sG,  "  (i.e. ,  where  an 
oxpliuiatiou  or  de.scriptioii  wa.s  required)  in  wliich  tiicro  wore  fow  explicit  liounds 
upon  Interviewee  responses.  An  intorvlewor  also  encouraged  iutcrviowQos  to  talk 
freely  of  ihoir  e.xporienccs,  lUid  to  give  exainplos  of  thoir  information  .search  and 
acquisition  paltorns, 

‘i,  2  yilRVEY  OPERATIONS  AND  CONTROLS 

Early  in  llio  .study  program  il  was  recognized  that  successful  results  would 
require  careful  planning,  scheduling  and  control  of  survey  operations.  It  was  also 
dear  that  data  collocied  in  tho  field  had  to  bo  monitored  for  quality,  so  that  con- 
dusioms  based  on  the  data  would  bo  valid  and  meaningful. 
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Sui’vey  operations  and  controls  included  correspondence  with  participating 
companies,  interview  scheduling,  aggressive  follow-up  of  missed  interviews,  and 
interview  quality  control.  Each  participating  organization  was  assigned 
a  control  number.  Upon  completion,  each  interview  was  assigned  an  accession 
number  to  maintain  control  and  facilitate  subsequent  analysis. 

Personal  in-depth  interviews  with  the  1500  users  lasted  an  average  of  1  hour 
and  40  minutes  per  interview.  All  interview's  were  conducted  in  private,  to  ensure 
confidentiality  and  to  prevent  bias. 

The  quality  of  the  analysis  depended  to  a  great  extent  on  the  quality  of  the  data 
collected  during  the  interviews.  Consequently,  appropriate  procedures  were 
developed  and  implemented  to  assure  consistently  high  quality  data  and  to  provide 
accurate  and  complete  inputs  for  computer  imalysis. 

Quality  control  extended  from  the  intei'view  itself,  through  keypunching  of  the 
data,  to  subsequent  analysis.  Interview  answers  w'ere  recorded  both  in  precoded 
and  in  narrative  foi'm.  To  minimize  errors  or  omissions,  each  interviewer  was 
required  to  review  and  inspect  the  material  from  each  interview  immediately  after 
its  completion,  but  before  the  next  interview'.  Completed  interviews  were  sent  to 
the  project  office  for  review  and  preliminary  audit  for  completeness,  consistency 
and  coding  accuracy.  Lnmediate  feedback  was  provided  to  interviewers  w'hen  needed 
to  correct  errors  or  improve  performance  on  subsequent  interviews. 

To  reduce  errors  in  transcribing  data  from  the  Interview  Guide  to  punched 
cards,  the  Interview  Guide  was  designed  so  that  coded  responses  could  be  punched 
directly  from  the  Guide  onto  cards. 

An  extensive  procedure  of  manual  editing  and  narrative  response  classification 
was  carried  out  to  ensure  the  maximum  completeness  of  the  data.  In  this  manner 
the  potential  "other"  and  "i\o  response"  entries  in  an  interview  were  largely  elimi- 
hated.  In  addition,  the  computer  analysis  had  various  automatic  edit  and  con¬ 
sistency  checks  built  into  its  routines. 

4.  3  ANALYSIS  OF  THE  DATA 

The  survey  data  consist  of  the  reports  of  1500  interviews,  each  containing 
answers  to  55  questions  having  qualitative  responses  and  8  questions  having 
quantitative  responses. 

Requirements  and  Objectives  of  the  Analysis 

An  analysis  should  provide  a  bridge  between  the  data,  and  meaningful  guide¬ 
lines  for  management  decisions  and  recommendations  for  the  future.  The  methods 
of  analytical  summarization  employed  should  be  sufficient  to  bring  both  the  detailed 
and  general  information  content  of  the  data  into  pi'oper  focus.  Otherwise,  manage¬ 
ment  will  be  obliged  to  accept  only  its  detailed  information  content,  or  seek 
additional  summarization  to  bring  out  its  general  information  content.  In  order  to 
achieve  this: 

•  The  analysis  should  first  summaidze  the  data  to  bring  into  focus  its 
detailed  information  content.  This  summary  of  data,  of  necessity, 
describes  only  small  portions  of  the  flow  process. 
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Table  4-1.  One  -Way  and  Two-Way  Frequency  Distributions 


TV,’ O'WAY  FREQUENCY  DISTRIBUTION 

Question  25:  Desired  Depth  of  Information 

Media 

MSPONSE 

A 

Detailed 

Analysis 

<N 

— 

Oi 

— 

f 

A 

Specific 

Answer 

1 

CO 

»i>^ 

o 

rH 

# 

CO 

CSI 

A  Oiice 

Over 

Lightly 

O 

•TO 

<N 

All  from  Recall 

One  Report  or 
Document 

A  Sampling  of 
the  Reports  and 
Documents 

Available 

All  Reports  and 
Documents  That 
Could  Be  Found 

Pertinent  to  the 
Question 

ii:u3toou02</5w 

EIPOJAI  UOtiClUJOjU] 

JO  oiuniOA  psJTsaa  -ZZ  uopsonQ 

•  The  analysis  should  then  further  sumniai’ize  the  data  to  bring  into  focus 
its  general  information  content,  so  that  both  small  and  large  portions  of 
the  flow  process  are  described. 

The  first  of  these  requirements  can  be  achieved  by  means  of  frequency 
distributions.  In  addition,  the  second  requirement  can  be  accomplished  by  the 
analysis  of  relationships  among  the  questions  in  the  Interview  Guido  (which  represent 
elements  of  the  flow  process).  Such  a  method  would  yield  sufficiently  summarized 
and  properly  focused  general  information,  describing  both  small  and  large  portions 
of  the  flow  process.  To  achieve  this  analysis,  however,  the  qualitative  data 
acquired  in  the  interviews  must  be  transformed  into  a  numerical  form. 

Thus,  the  objectives  of  the  analysis  aie. 

•  To  provide  detailed  information  describing  small  portions  of  the  flow 
process. 

«  To  transform  the  qualitative  data  into  numerical  form. 

•  To  provide  an  analysis  of  relationships  among  questions  in  the  Interview 
Guide. 

•  To  analyze  and  interpret  the  detailed  information  and  relationship  results 
in  order  to  provide  meaningful  guidelines  for  management  decisions  and 
recommendations  for  the  future. 

Outline  of  the  Analysis  Methodology 

The  detailed  information  describing  small  portions  of  the  flow  process  is 
provided  by  frequency  distributions  of  die  answers  to  single  questions  and  pairs  of 
questions.  Table  4-1  illustrates  a  "one-way  frequency  distribution”  (i.e. ,  the 
^stribution  of  the  percent  of  answers  to  a  question  that  corresponds  to  each 
question  response),  and  a  "two-way  frequency  distribution"  (i.e. ,  the  distribution 
of  percent  of  answers  to  a  pair  of  questions  that  corresponds  to  each  pair  of 
question  responses). 

As  illustrated  by  Table  4-2,  the  transformation  of  qualitative  data  into 
numerical  form  is  accomplished  in  two  steps: 

•  A  detailed  structure  is  developed  by  grouping  the  related  responses  to  a 
question  and  arranging  these  groups  (and,  to  the  extent  possible,  the 
responses  within  groups)  into  an  informative  order.  The  grouping  and 
arranging  are  based  on  the  primary  characteristic  of  the  question’s 
responses,  as  determined  from  tlie  responses  themselves  and  the  intent 
of  the  question. 

•  A  numerical  description  of  the  detailed  structure  is  defined  by 
associating  a  number  with  each  question  response.  The  base  point  for 
a  numerical  scale  is  selected,  according  to  the  primary  characteristic 

of  the  question.  With  each  response  there  is  then  associated  a  munerical 
value,  corresponding  to  its  relative  "distance"  from  the  base  p(  mt,  along 
a  scale  from  -1  to  1  (usually  from  0  to  1). 
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Table  4-2.  Transformation  of  Qualitative  Data  into  Numerical  Form 


Question  14:  First  Source  for  Inforiuation 


Informative  Order  A 

Scale 

I 

Received  witli  task  assignment 

0 

11 

Recalled  it 

0.05 

III 

Searched  own  collection 

0,  iO 

IV 

Respondent's  own  action 

0.15 

•  V 

Assigned  subordinate  to  get  it 

0.20 

VI 

Asked  a  colleague 

0. 25 

VII 

Asked  iny  su]>er visor 

0.30 

VllI 

Requested  search  of  department  files 

0.35 

IX 

Asked  an  internal  company  consultant 

0, 45 

X 

Searclied  company  information  center  1 

0.  50 

X 

Requested  library  searcii  j 

0.  50 

XI 

Requested  data  from  vendor,  manufacturer,  supplier  ) 

0.  60 

XI 

Searched  vendor,  manufacturer,  supplier  sources  ) 

0,60 

XII 

Searched  outside  library 

0.70 

XII! 

Asked  an  external  consultant  or  expert 

0.80 

XIV 

.  ij 

Requested  search  of  DOD  Information  Center  j 

0.90 

XIV 

Searched  DOD  information  Center  j 

0.90 

XV 

Asked  customer 

1.00 

A,  It  is  instructive  to  note  the  evolution  of  the  responses  ttiitl  their  order: 

1.  The  12  responses  to  Question  40  in  the  Phase  1  Interview  Guide  were  reordered  and  expanded 
into  the  16  responses  to  Question  14  in  the  Pliase  II  Interview  Guide. 

2.  Then  the  16  responses  were  expanded  to  18,  based  on  an  analysis  of  the  answers  to  the  response, 
"other  -  specify." 

3.  Finally  the  18  responses  were  arranged  into  an  informative  order,  according  to  their  primary 
characteristic,  wliicli  may  be  called  "distance  from  the  user." 

B,  No  distinction  '.s  made  betv/een  the  two  responses  in  this  grove  of  related  responses. 


Next  the  analysis  of  relationships  among  questions  is  performed  in  (he  following 
four  steps : 

•  Gro\ips  of  related  questions  are  arranged  into  an  informative  order  to 
form  a  general  structure.  To  the  extent  feasible,  the  arrangement  is 
based  on  the  desirable  characteristic  that  an  input  question  precede  an 
output  question  (i.  e, ,  a  question  tend  to  influence  only  those  questions 
which  follow  it).  An  example  is  contained  in  Table  4-3. 

_ Table  4-3.  Arrangement  and  Combination  of  Questions 

USER  COMPONENT _ 

I  - -  -  ----  . 

A.  Age  of  User:  Question  48 

B.  Education  of  User 

1.  Highest  Degree:  Question  50A 

2.  Field  of  Degree:  Question  50C 

3.  Year  of  Degree:  Question  SOB 

C.  Experience  of  User 

1.  Job  Experience:  Question  51 

2.  Company  Experience:  Question  52 

Combination  of  Questions:  l/2(Questlon  51  +  Question  52) 

D.  Position  of  User 

1.  Kind  of  Position:  Question  55 

2,  Field  of  Position:  Question  56 

E.  Level  of  User 

1.  Equivalent  Government  Service  (GS)  Rating:  Question  58 

2.  Personnel  Supervised:  Question  49 

3.  Type  of  Activity:  Question  54 

Combination  of  Questions:  l/2(Question  49  i  Question  58) 


•  Pairs  of  related  questions  are  combined  as  illustrated  in  Table  4-3,  in 
order  to  simplify  the  specification  and  estimation  of  models  describing 
the  flow  process.  Except  for  rare  cases  in  which  a  product  is  employed, 
all  of  the  Combinations  of  related  questions  are  averages  of  the  numbers 
pre-  iously  assigned.  3’he  scales  remain  between  -1  and  1  (usually  between 
0  and  1),  in  all  cases. 

•  Linear  models  are  .specified  to  represent  potential  relationships  among  the 
combinations  of  questions  in  the  genei*al  structure.  The  models  are  defined 
in  general  form  to  include  unspecified  constants  which,  when  evaluated, 
completely  determine  the  model. 

•  Uns|)ecified  constants  in  the  general  form  of  the  models  are  estimated 
from  the  data  by  the  technique  of  regression  analysis.  Regression  analysis 
also  indicates  the  significance  of  a  relationship  and  the  relative  contribution 
of  questions  to  the  relationship. 

Finally  the  analysis  and  interpretation  of  the  above  results  produces  meaningful 
guidelines  for  management  decisions  and  recommendations  for  the  future. 

4.4  COMPUTER  PROGRAMS  USED  IN  THE  ANALYSIS 

Two  basic  kinds  of  computer  programs  were  used  in  tlie  sbidy: 

•  Special  North  American  Aviation,  Inc.  programs  to  prepare  interview 
data  for  analysis. 

•  Biomedical  or  BMD  mograms  used  in  the  analysis  itself  (see  Reference  6), 
Three  of  each  kind  were  cu  >.ioyed,  brief  descriptions  of  which  follow. 

North  American  Aviation  Data  Preparation  Programs 

Creation  and  Utjdating:  This  prograiu  edits  all  inputs  and  creates  a  new 
tape,  or  mxiates  an  existing  one.  The  answer  to  each  question  is  tested 
for  proper  code  limits  and,  in  some  cases,  is  cross-checked  with 
answers  to  other  questions. 

•  Reox’der:  This  program  assigns  the  sequence  of  coded  responses,  in  tlie 
detailed  structure,  to  be  used  for  frequency  distributions. 

•  Rescale:  This  program  assigns  the  numerical  values  to  coded  I’esponses. 
Biomedical  Data  Analysi.s  Programs  (see  Reference  5) 


•  Transgeneration:  This  program  accepts  data  created  by  the  Reorder  or 
Rescale  Progi'am  and  combines  questions,  as  desired,  for  subsequent 
atialysis.  The  program  was  used  to  combine  questions  as  specified  in 
the  general  sti'ucture  (see  Table  4-3  and  Appendices  for  VoUuue  II). 
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•  I’wo-Way  Frequer.cy  Distribution:  This  program  computos  Ja)  two-way 
frequency  distributions;  (b)  Chi-square  value  and  degrees  of  freedom  for 
each  distribution;  and  (o)  means,  standaixl  deviations  and  correlation 
coefficients  for  each  pair  of  questions. 

•  Stepwise  Multiple  Regression:  This  general  purpose  statistical  program 
was  used  to  compute  (a)  a  sequence  of  estimates  for  linear  models  in  a 
stepwise  manner;  (b)  n  correlation  matrbc;  and  (c)  associated  significance- 
level  information. 
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5.  BACKGROUND 


The  DOD  User-Needs  Study  was  exploratory  in  nature.  It  attempted  to  structure 
and  describe  the  nebulous  process  of  the  flow  of  sciontlflc  and  technical  information. 
The  study  has  not  completely  solved  the  problems  of  defining,  designing  and  operating 
a  scientific  or(d  technical  Information  program.  Fome  of  the  reasons  for  this  are: 

•  The  DOD  U.ser-Needs  Study  was  the  first  investigation  of  its  size  and  scope 
dealing  with  a  large  portion  of  the  Information  flow  process,  and  its  com¬ 
ponent  users  and  tasks  within  major  segments  of  the  scientific  and  engineer¬ 
ing  Community, 

•  The  samples  from  Phases  1  and  II  exhibited  significntit  differences  in  their 
Users,  tasks,  utilization  of  information  centers  imd  services,  and  search 
and  acquisition  process. 

•  The  Phase  II  analysis,  although  compatible  with  that  of  Phase  I,  was  more 
comprehensive  and  definitive. 

•  Time  and  resource  limitations  precluded  the  accomplishment  of  more  than 
a  pi'eliminary  application  of  the  Phase  n  analytical  approach  to  the  Phase  II 
data,  much  less  its  application  to  the  Phase  I  data. 

«  The  more  comprehensive  and  powerful  aiialytical  approach  of  Phase  II  is 
novel  in  the  field  of  information  science;  and  the  results  should  be  regarded 
as  indicative,  but  not  conclusive,  and  meriting  additional  investigation. 

On  the  other  hand,  the  study  represents  the  Initial  step  essential  in  developing 
a  base  of  knowledge  on  which  to  build  future  programs.  It  has  investigated  the  flow 
process  from  within,  and  has  concentrated  on  the  study  of  the  user's  actual  experience 
relative  to  specific  tasks.  It  has  developed  a  (general  and  detailed)  structure  for,  and 
models  describing,  tlie  flow  of  scientific  and  technical  information.  This  structure 
and  these  models  have  yielded  valuable  insight  into  the  flow  process  and  its  elements. 

In  using  and  interpx’eting  the  results  of  this  study,  the  following  points  should 
be  kept  in  mind : 

•  Px'ior  to  these  studies,  no  definitive  description  of  the  composition  of  the 
DOD  PDT&E  and  defense  industry  populations  was  available.  Consequently 
no  attempt  was  made  to  select  a  stratified  sample  (this  is  now  possible, 
based  on  the  data  acquired  in  the  studies).  However,  the  broad  base  and 
large  samples  used  in  the  Phase  I  and  Phase  II  studies  are  representative 
of  the  scientific  and  engineering  communities  studied.  In  fact,  the  Phase  11 
data  exhibited  strong  internal  consistency. 

0  The  study  technique  of  investigating  "critical  incidents"  (in  this  case  a 
specific  task  that  was  recently  completed  by  the  user)  ensured  the  acquisi¬ 
tion  of  specific  data  on  tl»e  flow  process.  Thus,  the  data  acquired  in  the 
study  are  based  on  specific  expeiaences  in  the  interviewee's  work  situation, 
and  not  on  his  opinions,  judgmexxts  and  other  generalities. 

•  Tile  question  or  information  areas  covered  in  the  Interview  Guide  were  not 
closed-end  or  multiple  choice.  As  asked,  almost  every  question  required 
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a  freo  rosponst?  answei'  based  on  the  Intei'viewoe's  task-oidented 
experience . 


•  Tlio  imalysiv<j  has  conoentrnted  on  the  over-ail  sample  rather  than  its  com¬ 
partmentalized  aofrmentR.  Thus  a  description  of  particular  specialists 
(e.g.,  ehemlais,  electrical  engineers,  etc.),  olthough  feasible,  was  not 
attempted. 

♦  The  questions  and  pairs  of  questions  dealing  with  INFORMATION  (as  opposed 
to  those  dealing  with  the  I’SEH,  'I'ASK  or  UTILlZA'l'ION)  should  be  consid¬ 
ered  as  exclusively  INFORMATION  doscriptors.  In  that  they  are  drawnfi'om 

a  different  data  base  thaji  the  other  descriptors  (I.  e, ,  any  one  USER 
TASK  can  have  from  one  to  five  information  units  associated  with  them).  ' 

i>  Conclusions  involving  combinations  of  que.stion.s  .should  not  be  drawn  from 
the  frequency  distributions  of  .single  questions,  but  only  from  those  involving 
pairs  of  questions  and  the  models  of  relationships. 

#  In  order  to  analyze  the  data,  the  qualitative  responses  were  Irtuisforined 
Into  numerical  form  as  described  In  Section  4.3.  One  must  take  this  trans¬ 
formation  into  account  In  oixler  to  apply  the  results  of  this  study  intelligently 
to  information  programs.  If  a  different  transformation  is  desired,  then 
certain  portions  of  the  analysis  should  be  repeated  with  the  new  transforma¬ 
tion. 

♦  Estimates  of  models  describing  he  flow  process  are  sensitive  to  changes  in 
the  detailed  structure  and  its  numerical  description,  and  in  the  general 
structure  and  its  combinations  of  related  questions.  The  model  estimates 
in  Volume  11  must  then  be  taken  as  relative,  and  not  exact,  However,  the 
findings  and  guldollnes  for  management  decisions  in  Volume  I  have  been 
obtained  from  the  model  estimates  via  aJi  analytical  teclmique  which  mini- 

,  mlzes  their  sensitivity  to  such  chaiige.s.  This  technique  will  be  described 

in  Volume  II. 

The  px’esont  study  is  exploratory.  Its  rosultvS  sliould  be  cor.sidei'cd  indicative, 
but  not  conclusive,  mid  meriting  additional  investigation.  It  has  provided  a  useful 
beginning  in  the  definition  of  the  design  and  operational  criteria  for  scientific  and 
teclmical  information  programs.  A.s  described  in  Section  3,  additional  e.\perimenta- 
tion  and  refined  analysis  are  the  next  steps  to  undertake  in  the  analysis  and 
optimization  of  the  flow  process. 


"^Twenty-four  percent  of  the  USERS  performed  TASKS  which  had  an  output  as.soclated 
with  a  design  or  design  technique;  but  the  10  percent  of  INFORMATION  that  related 
to  design  or  design  techmque.s  represont.s  547  of  the  5359  separate  information  units 
that  were  used  in  the  survey  task.s.  These  547  information  miits  could  have  been 
used  by  anj'where  from  7  percent  to  ,36  pei'cent  of  the  u.SERS.  Therefore,  INFORMA¬ 
TION  questions  identify  INFORMATION  characterl.stics  and  not  those  of  USER,  TASK 
or  UTILIZATION. 
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1964,  Revised  1966. 
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APPENDIX  A,  PARTICIPATING  ORGANIZATIONS 


Number  of  Peraotis  Population  of 

Organ! z.;Uloii  Interviewed  Qualified  Personnel 


Aerospace  Corporation 

?,r> 

1800 

Allegheny  Ludlum  Steel  Corporation 

1 

80 

Allls-Chnlmei's  MnnufaoturiJig 

2 

185 

CompajTy 

Americait  Machine  &■  l’oundi\v  Company 

1 

100 

Ainpex  Corporation 

10 

760 

Arthur  D.  Little,  Inc. 

7 

800 

Armstrong  Cork  f'omp.'my 

A 

210 

AVCO  Corporation,  Pesearch  <md 

.31 

3500 

Development  Division 

Tlie  Babcock  s?  V’iicox  C'onipany 

3 

250 

Battelle  Memorial  Institute 

11 

775 

Bechtel  Corporation 

1 

70 

Beech  Aircraft  Corporation 

6 

470 

Boll  Aerosystems  Company 

11 

1000 

Bell  &:  Howell  Research  Center 

3 

500 

The  Bondix  Corporation 

G 

500 

Blssett-Berman  Corporation 

1 

66 

The  Boeing  Company 

G4 

G600 

Colt  Industries,  Inc. 

8 

725 

Cornell  Aot'onautlcal  Laboratory,  hic. 

6 

450 

Corning  Glass  Works 

G 

450 

Do  Laval  Turbine,  Inc. 

2 

160 

Douglas  Aircraft  company,  Inc. 

06 

8646 

Dupont  Company,  Tnc. 

'15 

3200 

Electric  storage  Battery  Company 

] 

200 

Emei'.'ion  Electric  Company  of  St.  Louis 

5 

325 

Falrchlld-niller  Corporation,  Republic 

1 

Aviation  Division  ' 

GCA  Corporation,  'roclmology  Division 

3 

146 

Genoi’fil  Dyuamic.s  Corporation 

129 

13155 

Gencr.alPrGcl.slon,  Inc.,  Link  Group 

8 

315 

Goodway  Printing  ConTpmiy.  Inc. 

3 

200 

Hamilton  Watch  Cojnpany 

1 

110 

Hazeltine  Corporation 

10 

800 

Hercules  Powder  Company 

23 

1350 

Honeywell,  htc.,  Aei'onauUcul  Division 

12 

910 

HRB-Singer,  Inc. 

G 

385 

IBM,  Federal  Sy.^tem.s  Dlvt.sion 

S'! 

3730 

Ingersoll-Rnnd  Company 

1 

55 

Institute  for  Defetise  Analysts 

15 

400 

Institute  of  Science  &•  Technology 

4 

475 

q 

Phis  person  had  just  joined  tlie  company  at  which  he  was  interviewed.  The 
interview  responses  reflect  his  position,  task,  etc.  ,  at  Republic  Aviation. 


APPENDIX  A.  (Cont) 


Nuihbof  of  pcrRoiiB  Population  of 

Ocyuni/.minn  intorviewcd  Qualified  Pc-raoiuiol 


liUernuttonnl  lliirveeter  C'ompni\y,  <1  250 

Holm*  UlviBion 

International  Hpslatnm'O  rotupjuij'  1  66 

Johns  Hopkins  r^'nlverslly.  Applied  M  660 

Physics  I.aborntory 

Kollsman  Injjlrument  ('orjio.rftiton  4  260 

I.oftr-Hiefflci',  Inc..  I’ower  Kquipinent  f)  055 

Division 

Loosonn  Moos  Laboratoj’ios  1  lOO 

I.iJig-Toinco-Vought,  Inc.  6S  35OO 

Loral  ICleetronlca  tiystcms  -I  660 

l.ord  Corporation  2  125 

Liuidy  Kloctronlcs  &■  Systejns,  Inc.  1  GO 

Management  Sy.siomfi  Corporation  l  20 

Ma.asachufietts  Institute  of  Toclmology  32  2000 

Monsanto  Company  44  3600 

Martin  Comp.aivv  100  7 000 

McDonnell  Aircraft  Cori>orfttion  27  1900 

Melpar.  Inc.  8  900 

Menasco  Manufacturing’  Company  1  66 

North  Amoiioan  Aviation,  Inc.,  21  1570 

Columbus  Division 

North  American  Aviation,  Ino. ,  269  18690 

Divisions  in  the  Los  Angeles 
Metropolitan  Area 

.  Northrop  Corporation  29  17,30 

OUn  Research  Center  4  3OO 

Otis  Elevator  Company  1  50 

Philco  Corporation  26  5000 

Pittsburgh  Plate  GIa.ss  Company  ,3  225 

The  RAND  Corporation  jj  750 

Raythocn  Company  4i»  4000 

Remington  Arms  Company,  Inc.  3  135 

Simmonds  Precision  Product.<3,  Inc.  2  190 

Sparton  CoviJorntlon,  h-loctronics  1  35 

Division 

Speri’y  Gyroocoixe  Company  9  G50 

Sprague  Electric  Company  7  5,j0 

Stanford  Research  ln.stltute  17  I2?9 

System  Development  Corporation  25  650 

'I'exas  Instruments.  Inc.  25  1500 

Thompson  Ramo-Wooldridge  Inc. ,  7  450 

Equipment  Laboratorie,s 

The  Tlmkin  Roller  Bearing  Company  5  ,355 

United  Aircraft  Corporation,  Norclea  1  275 

Division 

L’nitcdAii’crufl  Corporaiion,  1.',  ll‘^5 

Sikorsky  Aircral’f  Division 
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APPENDIX  A.  (CONT) 


Number  of  Persons  Population  of 


Organization 


United  States  Steel  Corporation 
University  of  Pittsburg 
University  of  Southern  California 
Vickers,  Inc. 

Western  Electric  Company 
Westinghouse  Electric  Corporation 


Interviewed 

Qualified  Personnel 

9 

700 

7 

500 

29 

1400 

f) 

380 

1 

120 

22 

1730 

1500 

119,470 
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APPENDIX  B.  COMPARISON  OF  PHASES  I  AND  II 


This  Appendix  presents  a  brief  compai'ison  of  the  results  of  Phases  I  and  II.  More 
detailed  findings  will  be  found  in  Volume  II.  Por  the  reader's  convenience,  the  more 
descriptive  terms  "DOD  In-House"  and  "Industry"  will  be  used  to  denote  the  Phase  I 
and  Phase  II  studies,  respectively. 

In  this  report,  continuing  reference  is  made  to  three  categories  that  are  used 
to  describe  the  information  needed,  the  output  of  a  task,  aiid  the  position  of  the  user. 
These  categories  are: 

KIND;  KIND  refers  to  the  area  of  effoirt  or  functions  such  as  research, 
development,  test,  evaluation,  production,  and  reliability  and  quality  control. 

CLASS:  CLASS  refers  to  the  type  of  content  such  as  concepts,  designs  or 
design  tecliniques,  experimental  processes,  performance  and  characteristics 
data,  specifications  and  evaluation  data, 

FIELD:  In  general,  there  are  tour  basic  FIELDS:  production  and  management, 
social  and  medical  sciences,  engineering  and  scientific.  The  Defease  Docu¬ 
mentation  Center  formerly  classified  its  infoi’mation  into  33  subfields  which 
relate  to  the  technical  disciplines,  the  processes  or  the  products  to  which  the 
information  pertains.  Examples  are:  aircraft  and  flight  equipment,  guided 
missiles,  production  and  management,  physics  and  mathematics. 

1,  llEVIEW  OF  PHASE  I  CONCIUSIONS 

The  DOD  In-House  study  produced  five  general  conclusions: 

•  Engineering  data  is  the  most  important  category  of  information. 

•  The  local  work  environment^  is  the  most  important  first  source  for 
information. 

•  Information  analysis  prior  to  distribution  is  important  in  a  scientific 
and  tecluiical  information  program. 

•  The  DOD  Information  Centers  and  Services  are  not  sufficiently  used. 

•  The  user  is  not  completely  satisfied  with  his  ability  to  obtain  information. 

Results  of  the  Industry  study  tend  to  confirm,  if  not  strengthen,  these  general 
conclusions.  Although  the  answers  to  comparable  questions  in  the  two  studies  exhibit 
significant  differences  (see  2  below),  the  general  results  imply  similar  conclusions 
(see  Section  2).  This  is  important  because  the  combined  DOD  In-Hou.se  and  Industry 
populations  represent  the  universe  of  originators  and  users  of  DOD  scientific  and 
technical  information. 


^  The  "local  work  environment"  extends  only  as  far  from  the  user  as  an  internal 
company  consultant,  but  not  as  far  as  the  company  Technical  Information  Center, 
which  is  his  connection  with  the  formal  information  system  (see  Table  4-2). 
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Table  B-1  sho\\\s  (he  five  general  conclusions  of  (ho  DOD  In-Houso  study  (lefl- 
hand  column),  (he  significant  statistical  findings  that  support  tlieso  conclusions  (center 
column),  and  the  corresponding  statistical  results  of  the  Industry  study  (right-hand 
column). 

2.  COMPARISON  OP  ANSWERS  TO  INTERVIEW  QUESTIONS 

The  i)\tent  of  luid  answers  to  37  of  the  que.stions  a.skecl  in  the  DOD  In-IIousc  and 
the  Industry  studies  are  similar  enough  to  lie  statistically  compared.  Thirty-four  of 
the  questions  (or  92  percent)  revealed  signilicanl  differences  tetween  tile  two  samples, 
and  only  three  questions  failed  to  exhibit  sucii  diffcronces.  Tlie  similarities  will  be 
described  first,  :ifter  which  the  .significant  differences  will  be  discussed. 

Sample  Similarities 

The  DOD  Li-House  and  Industry  samples  surveyed  were  similar  in  the  following 
relatively  unimportant  respects; 


•  The  proportion  of  the  received  information  that  was  essential  to  tlie  task. 
0  The  interviewer's  assessment  of  tlie  user's  need  for  information. 

•  The  proportion  of  the  user's  work-time  spent  in  accomplishing  the  task. 


Summary  of  Differences 


The  survey  questions  which  revealed  the  greatest  differences  between  the  two 
samples  were  in  the  search  and  acquisition  pi'ocess.  Significant  variations  were  also 
found  in  the  utilization  of  information  centers  and  service.s,  and  in  the  (ask  and  user 
characteristics.  The  important  differences  within  these  areas  are  as  follows: 


a.  In  the  search  and  acquisition  pi’ocess  (Figure  B-1),  the  Industry  users: 


•  Wanted  and  received  all  the  information  available  and  a  specific  answer 
more  often,  while  relying  less  on  recall  and  single  documents;  also,  they 
wanted  and  received  less  data  in  the  form  of  detailed  analyses  and  once- 
over-lightly  presentations . 

0  Received  less  information  with  the  task  assignment  than  was  the  case  with 
users  in  the  DOD  In-House  survey  and  were  less  dependent  upon  their 
local  work  environment  for  task  information.  However,  they  went  beyond 
the  local  work  environment  onij'  20  percent  of  the  time. 

•  Tended  to  use  a  first  source  more  because  it  was  available  or  the  only 
source  known,  and  less  because  they  were  told  or  i’ecalled  that  information 
was  available  from  that  source. 


35 


RECflVtU 


Db'SlIiEI) 


ONCEOVW  SPECIFIC  DETAILED 

lwhtly  answer  analysis 


DEPTH  OF  information  MEDIA 


RECALL  ONE  SAMPLING  ALL 

REPORT  material 

OB  AVAILABLE 

DOCUMENT 


RECALL  ONE  SAMPLING  AIL 

REPORT  MATERIAL 

OR  AVAILABLE 

DOCUMENT 


VOLUME  OP  INPORMATION  MEDIA 


ONE  DAY  DAYS  DAYS  so  pAYS  ONE  DAY  DAYS  DAYS  30  DAYS 

ACOUISITION  TIME 


PHASE  I  I  n  PHASE  1! 


Figure  B~i,  Comparison  of  Phases  I  &  II  -  Seai’ch  and  Acquisition 


•  Were  less  subject  to  time  constraints  in  the  acquisition  of  information;  the 
Industry  users  could  and  did  take  longer  to  gather  their  Information. 

•  Fotmd  post-task  information  more  often  than  users  in  DOD  In-House 
sample. 

•  Used  their  information  more  directly  in  task  accomplishments  and  less  as 
background  information. 

b.  In  the  use  of  Information  centers  and  services,  the  Industry  users: 

•  Encountered  more  problems  in  the  acquisition  and  the  use  of  information 
(Figure  13-2). 

•  Were  more  often  unaware  of  the  availability  of  the  DDC,  TAB,  etc.  (but  a 
greater  percentage  of  those  who  knew  of  these  services  used  them). 


PHASE  I 
PHASE  II 


71.5% 


HAD  DIFFICULTIES  NO  DIFFICULTIES 


Figure  B-2.  Comparison  of  Pha-ses  I  and  II  -  011112.111011  Difficulties 
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c.  The  tasks  in  the  Industi'y  sample  (Figure  B-3): 


•  Involve  fewer  soU-generoted  tasks  and  mox'e  tasks  directed  outside  the 
DOD  or  company. 

•  Deal  more  with  concepts,  design,  production,  research,  aerospace, 
aircraft,  electi'onics  and  pi'opulsion  systems.  On  the  other  hand,  the 
DOD  tasks  are  moi'e  concerned  with  test  processes  and  procedures,  costs, 
funding,  administrative  action,  operational  development,  oitlnance, 
medical  science  and  communications, 

•  Involve  a  larger  number  of  formal  and  written  task  outputs. 

•  Involve  a  longer  task  duration. 


80% 


TASK  OUTPUT.  -  5K  OUTPUTS 
DIHECTED  %.'ECTED 

WITHIN  DOD  TSIDE  DOD 

OU  COMPANY  OU  COMPANY 

DIHECTION  OF  TASK  OUTPUT 

3  PHASE  n 
■  PHASE  I 


71.0% 


FORMA  I.  INFORMAI, 

FORMA  UTY  OF 
TASK  OUTPUT 


80% 


WRITTEN  VS  ORAE 
TASK  OUTPUT 


Figure  0-  3.  Comparison  of  Phases  ]  &  II  -  Task 


38 


TKCimiCAl,  SCIKNIII-IC*  -MJMINISTHATION 
!■  VAM!ATION  TliCIINICAL 

■rvi’F;  OF  \vonK  activity 


ONi;  YKAI!  QKF  TO  FIVE  OVEII  FIVE 
OH  I, ESS  YEAHS  YEAHS 

YEAHS  IK  KlKl)  OF  WOHK  AC  TIVITY 


PHASE  II 
PHASE  I 


Figure  B-4.  Comparison  of  Phases  I  &  II  -  User 


3.  COMPARISON  OF  ANSWERS  TO  PARIS  OF  QUES'l'TONS 


Tho  Phaso  I  Final  Report  (Reference  1)  discussed  4G  pairs  of  questions  in  which 
the  answers  to  one  question  (sucli  as  "'I'yiw  of  Activity")  are  distributed  against  tlio 
answers  to  luiother  question  (such  as  "Do  you  use  ODC  ?").  In  this  example,  such  on 
analysis  would  reveal  any  tendency  of  users  involved  in  a  particular  activity  to  make 
different  use  of  the  DDC  than  users  In  another  activity. 

In  the  present  Industry  study,  43  of  these  potential  relationships  were  investi¬ 
gated  and  the  findings  compared  with  those  of  the  DOD  In-House  study.  It  was  found 
that  the  DOD  In-House  results  are  contradicted  by  those  of  the  Industry  study  about 
as  often  as  they  are  subslantiatod.  This,  however,  is  not  surprising  in  view  of  the 
many  differences  between  the  two  samples,  as  demonstrated  above. 

General  Areas  of  Agreement 

The  areas  in  which  the  Industi*y  findings  agree  with  the  DOD  In-House  results 
relative  to  pairs  of  questions  ai'e  as  follows: 

•  As  the  desired  volume  of  information  increases,  the  required  acquisition 
time  also  Increases. 

•  No  relationship  exists  between  tho  discovery  of  post-task  infoxnnation  and 
user  attributes  (such  as  salax'y,  education,  kind  of  activity,  etc.). 

•  A  high  portion  of  reseax'ch  tasks  are  found  in  the  fields  of  medical  science 
ojxd  physics,  in  the  utilization  of  concepts,  and  In  situations  involving  the 
use  of  libraries  as  a  first  source. 

•  About  25  percent  of  the  users  are  called  upon  to  perform  tasks  that  are 
outside  their  normal  kind  or  field  of  work  activity.  Thi.':  tendency  is 
greatest  for  woi'kers  in  the  field  of  mathematics,  and  least  for  those  in 
the  medical  sciences. 

•  Individuals  having  advanced  degrees  (i.e. .  having  more  baokgx'ound  and 
training)  report  more  pi'obloms  in  the  acquisition  and  use  of  information. 

Areas  of  Major  Diffei'ence 


Tlie  meaningful  areas  in  which  differences  were  found  are  outlined  below.  In 
each  instance,  the  earlier  DOD  In-House  study  indicated  either  no  signlficaxit  I'ela- 
lionship,  or  a  specific  contradicting  characteristic.  The  study  of  the  Defen.se 
Industry  showed  that: 

•  The  need  for  performance  and  characteristics  data  is  approximately 
uniform  througliout  all  phases  of  the  re, search,  development  and  production 
cycle;  that  is,  the  need  for  such  data  occurs  about  as  often  in  the  early 
phases  as  in  the  later  phases. 

•  A.S  the  desired  volume  of  information  increases,  the  use  (or  potential  use) 
of  title  listings  and  abstracts  increases. 


9  The  discovery  of  ix)st-tttsk  information  is  not  related  to  tlie  phases  of  the 
research,  development  and  production  cycle,  or  to  the  field  of  aotivlty  of 
the  user  (such  ns  production  and  management,  engineering  or  scientific). 

9  As  the  work  proceeds  away  from  research  ajid  toward  aii  end  product,  there 
Is  less  need  for  depth  in  Information. 

•  Longer  task  durations  are  related  to  the  use  of  first  sources  for  information 
that  are  more  distant  from  the  user,  atid  longer  acquisition  times  for 
information, 

•  It  takes  longer  to  acquire  information  whose  first  source  is  more  distant 
from  the  user, 

9  The  higher  the  user's  salary  level  and  Importance  to  his  company,  the 

more  he  tends  to  encounter  pi’oblenis  in  the  acquisition  and  us©  of  scientific 
and  technical  information. 

The  DOD  In-House  and  Industry  scientific  and  engineering  commimities  are 
apparently  different  in  many  individual  aspects.  However,  as  general  users  of 
scientific  and  technical  Information,  they  exhibit  many  similar  tendencies  and  relation¬ 
ships.  It  is,  therefore,  desirable  to  apply  the  more  powerful  analysis  of  Phase  11  to 
the  Phase  I  data  and  the  combination  of  Phase  I  ajid  Phase  II  data. 


41 


APPENDIX  C.  SUMMARY  OF  PHASE  II  FINDINGS 


Refer  to  the  beginiiing  of  Appendix  B  for  the  definitions  of  kind,  class  nnci  Hold. 


1.  THI';  SEAItCIl  AN'D  AC(,n‘lSn'l(>N  1>R(.)CKSS 


In  studying  the  search  aiul  acqulsllloii  process,  tlio  answers  to  iJio  following 
questions  arc  of  prime  interest : 

*  VViud  Infornuilion  is  involvcc' ‘i* 

*  lly  what  nieiliu  does  the  user  desire  to  receive  the  Information? 

•  To  which  aoureu'  does  the  user  go  first  ? 

•  VVhon  is  tliO  formation  needed?  When  Is  it  acquired? 

This  ixjrtlon  of  Aiipondix  C  presonts  the  more  significant  findings  relating  to  these 
questions, 

What  Information  Is  Involved  ? 

The  class  of  Information  was  over  Gu  jH  i'cent  design  and  |>orformnnce 
(Figure  C-l). 

Figure  C-2  .shows  tliut  almost  half  of  the  information  wa.s  in  the  engineering 
field,  and  almost  dO  percent  was  in  the  sciontlflc  field. 


As  would  bo  exiweted,  the  class  and  field  of  InforuuUion  required  for  the  task 
are  mostly  related  to  the  kind,  cla.ss  and  field  elements  of  the  task.  When  the 
pnten.tia!  rEdalionshipS  wltliin  tlio  .'^oarch  tind  acqui.-^iiion  procc.ss  are  considered,  the 
class  and  field  of  information  arc  not  significantly  related  to  the  other  descriptors 
(such  as  media,  etc.).  They,  llK'relbre,  identify  information  areas  and  not  necessar¬ 
ily  other  .scare'll  and  acquisition  characteristics. 


Hv  What  Medi.a  Docs  the  tbser  Desire  to  Receive  the  Information? 

III,  I  I  I  ■— I  m  im,  . . .  I  I  I  —  I  I  MIM  ■ 

The  significant  chai'actorlstlcs  of  the  desired  media  for  convoying  information 
are  defined  in  terms  of  their  formality  (com(x>,si11on  and  layout),  volume  (extent)  of 
dooumenlallon  and  deptli  of  detail  (Figures  C-G  and  C— 1): 


#  More  than  one  out  of  ihree  users  desired  to  receive  information  orally,  and 
more  than  one  out  of  tiiree  users  desired  to  rcccfvc  it  semiformally  written. 

•  Almost  three  out  of  five  users  desired  a  textual  layout. 

*  More  Ilian  three  out  of  five  wanted  more  than  one  document. 


*  Almost  all  users  wanted  juore  detail  than  once  over  lightly  (almost  three 
out  of  five  wanted  a  si^ecilic  an.swcr). 


TIk’  volume  and  dc))th  of  iixformaliou  i-eceived  was  lo.ss  than  tluil  de.sired  in 
al)out  one-seventh  of  the  ca.scs. 


4.-f 
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Figure  C-3.  Desired  Formality  for  Information  Media 
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Figure  C-4.  Volume  and  Depth  of  Information 
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The  analysis  revealed  a  significant  relationship  which  indicates  that  the  desired 
coin|X)sition  and  layout  of  the  media  is  mainly  related  to  the  desired  extent  of  the 
media  wliich,  in  turn,  largely  depends  on  the  duration  of  the  task. 

To  Which  Source  Does  the  User  Go  First? 

About  30  percent  of  the  user's  needs  were  satisfied  without  search,  and  50  per¬ 
cent  were  sought  within  his  local  work  environment  (Figure  C-5).  These  first  sources 
almost  always  yielded  jiart  or  all  of  the  information  needed. 

The  following  significant  relationships  were  found  regarding  the  first  source 
that  was  used: 

•  The  |)artieular  first  source  used  is  mainly  related  to  the  reason  for  its  use 
and  the  composition  and  layout  of  the  media.  'I’he  sources  more  remote 
from  the  Individual  were  used  more  often  when  they  were  known  to  have  the 
desired  information  and  for  the  more  formally  documented  information. 

•  As  allowable  acquisition  time  increases,  there  is  a  tendency  to  use  first 
sources  that  are  at  a  greater  distance  from  the  user. 

4  What  was  acquired  from  the  first  source  depends  on  the  desired  composition 
and  layout  (formality)  of  the  medium  from  which  the  information  was  to  be 
obtained,  and  the  amount  of  time  available.  As  the  desired  formality  and 
time  available  increased,  the  amount  of  information  gained  from  the  first 
source  decreased. 

When  Is  the  Information  Needed  and  Acquired  ? 

Almost  75  percent  of  the  information  is  needed  within  30  days,  while  over 
80  percent  is  acquired  within  30  days  (see  Figures  -1).  With  the  exception  of  5  per¬ 
cent,  the  information  needs  were  satisfied  within  the  allowable  acquisition  time 
(Figure  C-6). 

The  following  relationships  were  found  involving  the  time  by  which  information 
was  needed  and  the  time  by  which  it  was  acquired: 

•  The  allowable  time  for  the  acquisition  of  information  is  most  related  to  the 
duration  of  the  task. 

•  The  time  to  acquire  the  information  is  mainly  related  to  the  duration  of  the 

task,  and  the  desired  composition  and  layout  of  the  media,  ' 
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Figure  C-6.  Timely  Acquisition  of  Information 


Miscellaneous  Questions:  How  Useful  Are  Abstracts  ?  How  Often  Is  There  Late 
Discovery  oi  Iuforination?'~How  Inadequate  Is  the  Seai’ch  and  Acquisition  Process? 

«  Title  listings  or  abstracts  would  have  been  useful  for  finding  move  than 
do  {percent  of  the  user's  infonnation  requirements. 

♦  In  general,  the  usefulness  of  title  listings  or  abstracts  depends  mainly  on  the 
desired  composition  and  layout  of  the  media  for  conveying  Information  and 
the  effort  which  the  user  devotes  to  the  utilization  of  information  centers 
and  services. 


♦  For  one  out  o(  five  tasks,  information  tliat  was  availnblo,  but  unknown, 
during  the  task  was  discovered  too  late  to  bo  usoful. 

♦  Those  users  who  encountered  probloms  in  the  use  of  information  centers 
and  services  were  the  ones  most  likely  to  discover  information  that  was 
available,  but  unltnown  to  them,  dux'ing  work  on  a  task. 

•  In  general,  the  inadeciuacy  of  the  seuroh  and  acquisition  process  (as 
measured  by  tlie  inability  of  the  user  to  obtain  information  in  tlie  form, 
depth,  vokune,  time,  etc,  desired)  is  most  related  to  the  duration  of  the 
task;  the  inadequacy  increases  ns  task  duration  increases. 

2.  THE  UTILIZATION  OF  INFORMATION  CENTERS  AND  SERVICES 

The  more  significani.  findings  concerning  the  utilization  of  information  centers 
and  services,  and  problems  which  the  users  have  encountered  in  this  utilization  are 
now  presented. 

The  Utilization  of  Itxformation  Centers 

•  The  company  Technical  Information  Centers  are  utilized  by  almost  all 
industi'y  users  of  scientific  and  technical  information. 

#  The  Defense  Documentation  Center  (DDC)  is  utilized  by  almost  one  half 
of  the  users  (Figure  C-7). 

♦  On  the  other  hand,  the  DDC  is  unknown  to  almost  one  out  of  three  of  the 
users  (Figure  C-7). 


Figure  C-7.  Use  of  Dc  fense  Documentation  Center 


♦  Over  40  percent  of  the  wsers  of  scientific  and  technical  information  make 
U30  of  the  DOD  Specialized  Informntion  Centers  (Figure  C-8). 

♦  On  the  other  hand,  the  DOD  Speoialized  Information  Centers  are  imknown 
to  more  than  ene-third  of  the  users  (Figure  C-8). 
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Figure  C-8.  Use  of  DOD  Specialized  information  Centers 


«  Other  Specialized  Infoimiation  Centers  are  utilized  by  almost  one-third  of 
tlie  users. 

Significant  relationships  which  bear  on  the  utilisation  of  various  information 
centers  were  revealed  in  tlie  analysis  of  data.  They  are: 

•  The  extent  to  which  company  Technical  Information  Centers  are  used  is 
most  related  to  the  user's  kind  of  work;  tliey  are  used  more  by  users  in  the 
early  phases  of  the  research,  development  and  production  cycle  than  by 
those  later  in  tlie  cycle. 

«  Tlie  users  of  the  DDC  also  tend  to  make  corre3ix>nding  use  of  DOD  and 
other  Specialized  Infoxinatiou  Centers. 


The  higher  the  user's  level  and  value  to  his  company,  the  more  use  he  tends 
to  make  of  the  DOD  and  other  Specialized  Information  Centers. 


The  Utlliziition  ol' Information  Sc'rvlccs 


*  The  Technical  Abstract  Bulletin  (TAD)  is  used  by  more  than  one-third  of 
the  users  of  scientific  and  technical  information  (I'igure  C-9). 

•  The  TAB  is  unknown  to  over  *10  percent  of  these  users  (Figure  C-9). 

♦  The  Niitiottal  Aeronautics  and  Space  Administration  (NAS.A)  Scientific  and 
Technicnl  Aerospace  Reports  (STAR)  arc  utilized  by  almost  20  p<-  -.-ent  of 
the  users  of  scientific  mid  technical  information.^ 

♦  The  STAR  is  nnkiiowai  to  almost  two-tiiirds  of  the  users. 

*  Eiigllsli  abstracts  and  Irnnslalions  cf  foreign  literature  are  used  by  almost 
•10  percent  of  the  user.s. 

Significant  relationshi|i.s  which  bear  on  the  use  of  the  various  information  ser¬ 
vices  are: 

♦  Tlie  use  of  aorvioGs  is  interrelated  -  the  users  of  one  service,  such  ns 
the  TAB,  are  more  than  likely  the  users  of  other  services. 

•  The  use  of  services  is  related  to  the  work  level  of  the  user,  as  measured 
by  (a)  highest  degTce;  (b)  ixisition  in  the  research,  development  and 
production  cycle:  and  (c)  salary  level. 
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Figure  C-9.  Use  of  Tcchnic.al  Absiract  Bulletin 


!) 


It  should  be  noted  that  Idiase  II  was  concerned  with  DOD  coiuractors,  who  may  or 
may  not  be  NASA  Contractors. 


Problems  EnoouiUorod  lii  tlio  Uae  of  lnl‘ot‘malioii  Contort  unci  Services 


Ovei'  one  oat  of  three  users  encounter  proprietury  or  security  roslriclions, 
with  GO  percent  being  concerned  with  security  (Figure  C-10). 
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are  encountered  by  over  (wo  oui  of  live  users.  Almo.st  iwo-nfllis  of  (liese 
cillflcultios  involved  timely  awareness  of  information,  and  over  half  of  them 
involved  timely  acquisition  of  inforrn.ntion  (Figure  C-ll). 
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♦  Timely  awarenosB  difficultios  are  cvonij'  divldccl  botweeii  bolUj?  Interiuil 
a»cl  external  to  the  company,  while  timeiy  ac<|Ulsitioi»  aiic!  ulilliy  tlifficultics 
nre  much  more  often  external  than  Internal. 

♦  The  solutions,  suggested  by  the  users,  for  these  difflcultlcR  (l-'lgurc  C-12) 
support  the  guidelines  for  management  deeision.s  of  Section  2. 


'rhe  following  significant  roglallonshlps  were  found  regarding  the  encounter  of 
problems  In  the  acqul.sltlnn  of  liiformation: 

#  The  oncounter  of  problenns  {reslriclions  and  diffitmltioR)  was  related  lo  the 
use  of  information  centers  and  scrvico.s.  Those  users  who  were  more 
Involved  in  the  use  of  Information  oonlors  and  services  encountered  and 
reported  more  problems  than  those  who  made  less  use  of  those  facilities. 

•  The  higher  level  Individuals  encountered  and  reiwrted  more  problems. 

3.  THE  SCIENTIFIC  OH  'j-ECHNICAL  TASK 

The  analj'sls  of  the  scientific  oi'  tocl..iical  task  was  concerned  with  the  major 
output  of  the  task,  and  the  duration  and  intenalty  of  effort  for  the  task. 


The  major  output  of  the  scientific  or  technical  task  Is  described  in  terms  of  tJic 
categories  of  kind,  class  and  field. 

•  By  kind,  two-thirds  of  the  tasks  are  concornerl  \vith  the  development 
function  (Figure  C-13). 

•  By  elans,  two-thirds  of  the  la.sk.s  involve  design  aiul  peiToi'inance  data. 

•  By  field,  more  than  one-liair  of  the  tasks  Involve  engineering  and  one-third 
of  them  involve  scientific  actlvity- 

The  major  relationships  identified  ureas  follows: 

•  The  kind  and  class  of  the  major  output  of  the  task.s  are  closely  Idenllficd 
with,  the  user's  kind  of  work  activity.  It  was  found  that  -i-l  percent  of  the 
users  cl\anged  from  one  kind  of  work  activity  to  tasks  whose  major  output 
was  of  another  kind.  The  cross-over  Is  lowest  for  basic  research  and 
reli.nbilily  and  quality  control  personnel,  and  highcbl  for  engineering 
development  and  customer  relations  personnel. 

•  The  field  of  the  major  output  of  a  la.sk  Is  most  closely  identified  with  the 
field  of  llio  user's  work  aefivitv.  On  llie  average,  27  percent  of  the 
IJcr.sonncI  left  Ibeir  normal  field  of  work  activity  to  carry  out  a  task  tlial 
was  basically  in  another  field.  Twenty -five  percent  of  all  cross-overs 
wore  into  aeronautics  and  space  technology.  The  least  amount  of  cross¬ 
over  wa.s  from  the  medical  sciences  (13  percent)  and  cliomical  sciences  aiul 
materials  (17  percent).  Tin?  g real e.st  amount  of  cross -over  was  from 
mat'ieniatic.s  (."id  pereont) 


'I'hc  majoi  outpiil  ol  inoie  ihan  oO  poreenl  oi  Ihe  tasks  was  preseiiled  lii  a 
(tocunic'nl,  while  more  Ilian  7()  pcreont  of  the  major  task  outjHits  (both  docnuiiciitccl 
and  oral)  were  lornial  in  nature  (Figure  C-Fl). 
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Figure  C-14.  Formality  of  Task  Output 

Figure  C-15  shows  that  the  major  output  of  more  than  50  percent  of  the  tasks 
was  a  finding. 

The  analysis  revealed  a  significant  relntinn.sliip  indicating  that  llic  formality  and 
type  of  the  major  output  of  a  task  are  mostly  related  to  the  level  of  t.lie  user  in  his 
company,  and  the  recipient  of  the  task  output. 

Duration  and  Intensity  of  Effort  for  Task 

♦  Almost  one-half  of  (he  tasks  were  from  oia  to  si.K  monlli  in  duration,  and 
almost  40  percent  were  one  month  or  less  (Figure  C-li  ). 

«  The  percent  of  the  user's  time  devoted  to  tasks  lends  to  be  uniformly 
distributed. 
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Figure  C-lf).  Type  of  Task  Output 
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Figure  C-tG.  Task  Duration 

'I'he  analysis  disclosed  a  relationship  indicating  that  the  duration  of  a  task  tends 
to  bo  gieator  during  tiie  earlier  phases  of  the  research,  development  and  production 
cycle. 


4  THE  USEE  OF  SCIENTIFIC  AND  TECHNICAL  INFORMATION 


The  analysis  of  the  user  of  scientific  and  technical  infoi  mation  was  concerned 
mainly  with  what  he  does  and  who  he  is . 

What  He  Does 

•  Two  out  of  three  users  are  in  development  work. 

•  Over  half  of  the  users  are  engaged  in  engineering  activity  and  more  than 
one-third  of  them  are  engaged  in  scientific  activity. 

•  Tlie  higher  the  user’s  degree,  the  more  likely  he  is  to  be  involved  in  work 
occurring  earlier  in  the  research,  development  and  production  cycle. 

•  The  field  of  the  user’s  position  (i.e. ,  production  and  management,  engineer¬ 
ing  or  scientific)  is  most  related  to  the  field  of  his  highest  degree. 


Who  He  Is 


•  More  than  half  of  the  users  possess  a  bachelor 's  degree  and  almost  one  out 
of  three  users  possesses  an  advanced  degree. 

•  Two  out  of  five  users  are  in  nonsupervisory  positions  and  one  out  of  three 
users  supervises  from  one  to  five  persons. 

•  Three  out  of  four  users  are  in  salary  levels  corresponding  to  the 
Government  Service  GS-11  to  GS-14  level  (and  then  tend  to  be  uniformly 
distributed  within  that  range). 

Significant  relationships  among  user  attributes  are: 

•  .  Although  the  user’s  age  is  not  significantly  related  to  his  highest  degree, 

his  age  is  related  to  the  field  of  his  highest  degree.  Younger  persons  hold 
more  degrees  in  mathematics  and  science,  while  the  older  ones  have  more 
degrees  in  engineering  fields. 

•  The  equivalent  GS  rating  of  the  user’s  salary  level  is  most  related  to  his 
highest  degree. 

5.  SIGNIFICANT  FACTORS  WITHIN  THE  FLOW  PROCESS 

The  comparison  of  Phases  I  and  n  in  Appendix  B  has  been  made  in  terms  of 
small  portions  of  the  flow  process  (i.e. ,  answers  to  comparable  questions  and  pairs 
of  comparable  questions).  A  unique  result  of  the  industry  study  is  the  identification 
of  significant  factors  within  the  flow  process.  These  factors  will  be  described  from 
a  systems  design  point  of  view. 

It  is  quite  informative  to  consider  the  input/output  relations  among  the  USER, 
TASK,  UTILIZATION  and  SEARCH  AND  ACQUISITION  components  of  the  flow  process 
and  among  qucrtior.s  contained  in  them  (sec  Scctioi.  2.5).  Depending  upon  the  portions 
of  the  flow  process  under  consideration,  a  given  component  or  question  may  sometimes 
be  thought  of  as  an  input  (i.e. ,  tending  to  influence)  and  sometimes  be  thought  of  as  an 
output  (i.e. ,  tending  to  be  influenced).  Figures  C-17  through  C-21  depict  these  input/ 
output  relations. 
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Figure  C-17.  Inpul./Oulpiit  Relations  for  the  Search  and  Acquisition  Process 

Ill  general,  the  USlsK,  TASK  and  UTILIZATION  components  act  as  inputs  to 
SEARCH  AND  ACQUISITION.  (Sec  the  arrows  marked  d  in  Figure  C-21).  Those 
factors  that  are  most  roiatod  to  SEARCH  AND  ACQUISITION  are,  in  order  of  their 
significance: 


a.  riio  extent  to  wliicli  the  user  employs  information  centers  and  services. 

b.  The  desired  composition  and  layout  of  the  media  for  convejdng  iiiformalion. 

c.  The  desired  volume  and  depth  of  the  conveying  medium. 

d.  The  kind  and  class  of  tlie  major  output  of  the  scientific  and  technical  tasks. 
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Inlorination  Ccnti'r,  (h)  Defense  Doennicntation  ('entc!'.  (c)  and  other 

Specialized  Information  (.“enters,  (d)  Teclr.iicii!  Abstract  lUilletln,  (c) 
Scientific  and  rechnlcnl  Aerospace  Reports  and  (f)  EiiRlIsh  abstracts  or 
tra  nslatlons. 

*  The  output  factors  represented  by  the  (a)  rest  riel  Ions  and  difficulties 
encountered  by  tiic  user  in  his  uliiizntion  of  information  centers  and 
services,  (b)  e.Ntent  to  which  the  user  utilizes  information  centers  and 
services,  and  (c)  extent  to  which  the  user  encounters  restrielioiis  and 
difficuitios  in  this  utilization. 
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KiRure  C-18.  Input /Output  Relations  for  the  Utilization  of  Information 

Contors  and  Services 

In  Roneral,  the  USER  component  acts  as  an  input  to  UTILIZATION  (see  arrow 
3  in  I’ipuro  C-21).  Those  factors  most  related  to  UTILIZATION  are,  in  order  of 
thei  r  signilicancc; 

a.  The  user's  kind  of  position. 

b.  The  user's  .salary  level  and  number  of  people  ho  supei'vises. 

c.  The  user's  highest  degree. 
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4  '!  bo  inpul  fiu-lnr*^  i  fiircsctilod  ‘>v  tlif  luiul,  rl;i.sK  .iml  fioUi  of  tl>c  task's 

major  autpiil, 

*  riit'  oul|uit  I'artfirs  rrprpscntcd  by  the  fnrniallly  and  type  of  the  task's 
major  outpiit  ami  the  ('ii  rat  ion  of  the  task. 


Figure  Input /Output  itelntlou*^  lor  the  Scientific  or  Technical  Task 

In  general,  the  USER  cojnponcnt  acts  as  an  input  to  the  TASK  (see  arrow  2  in 
I'iguro  C-21).  those  liuitors  most  relutcti  to  the  TASK  are,  in  order  of  importance: 

u.  The  user's  kind  of  iwEition. 

b.  The  kind  and  class  of  major  output  of  llie  task. 

The  User  of  .Sclpnllfic  and  Technicit!  Infot  iiiation  (see  Tigure  C-.20) 

The  factors  that  bc.st  describe  the  USER  are: 

♦  'Ihe  input  factor  represented  by  the  user's  higlicst  degree. 

♦  'i'he  output  faclor.s  represenlod  by  (a)  liie  kind  and  field  of  the  user’s 
|x>.stfion,  (b)  the  niuribcr  of  (icoijIc  ho  .supor\'ise.s  mid  (c)  his  salary  level . 

G.'l 


FiKure  C-20.  iiipul/Outpul  Hi'lalionB  for  llu'  I  ser  of  ScieiUlfio  and 

Technlcul  Information 


The  Flow  Pi-pcess  (see  Flgvn'e  C’-2l> 

The  factors  that  best  desrlbo  the  FLOW  PflOCKSS  arc  (see  arrow  1  In 
I'lRure  C-2i) 


4  »*\  4  M)  <VS  '  4  (IN,  VI*. 

components. 


vrp resettled  by  qn*  i-ontained  in  the  PSKH  and  TASK 


The  oui|juI  Ifictors  roji relented  bv  fiiicstions  oonltiiiiod  in  tlio  U  riLI/.ATiOK 
r.iul  SKAltCll  AND  ACQUISITION  components. 


The  flow  process  is  the  combination  of  the  USKR,  TASK,  UTILIZATION,  .and 
SICAHCH  AND  .ACQUISITION  components.  Those  factors  that  .arc  most  relnlcKl  to 
Ihi.s  combi  nation  of  com|)oneiUs  are,  in  order  of  their  siRnifiennee; 


a.  The  user's  kind  of  position. 

b.  The  user's  highest  degree. 

c.  The  u.scr's  salary  love!  and  mnnber  of  people  he  supervises. 

d.  The  kind  and  el.ass  of  the  major  output  of  the  1a.sk. 

0.  rhe  e.xlcnt  to  which  the  user  employs  information  centers  and  .services. 
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The  Department  of  Defense  (DOD)  has  conducted  a  tw'o-phase  study  to  determine  how  scientist5 
and  engineers  in  government  and  industrial  research,  development  and  production  activities 
acquire, information  for  performing  work  assignments  on  DOD  programs.  The  Phase  I  study 
covered  the  information  needs  of  DOD  personnel  engaged  in  research,  development,  test  and 
evaluation  (RDT&E)  activities. 

Phase  n  of  this  study  investigated  tlie  nation's  defense  industry  to  determine  its  information 
needs,  and  the  flow  of  scientific  and  technical  information  (flow  process)  inherent  in  satisfying 
those  needs.  It  is  based  on  a  representative  sample  of  1500  individuals  from  approximately 
120,000  scientists,  engineers,  and  technical  personnel  in  83  organizations  in  the  defense 
industry.  Sixty-three  (pestions  were  asked  them  regarding  the  user  of  scientific  and  technica 
information,  his  scientific  or  technical  task,  his  utilization  of  information  centers  and  services, 
and  the  search  and  acquisition  process.  The  analysis  included  compilation  of  frequency  dis¬ 
tributions  for  answers  to  questions  and  pairs  of  questions.  In  addition  the  qualitative  data 
have  been  transformed  into  numerical  form,  and  models  have  been  specified  for  relationships 
among  elements  of  the  flow  process.  The  models  are  estimated  from  the  data  by  means  of 
regression  analysis,  to  yield  significant  relationships  and  factors  within  the  flow  process. 

Tlic  Phase  II  Final  Report  describes  the  results  of  Phase  II,  and  compares  them  with  those  of 
Phase  I.  It  is  presentf^fl  in  three  volumes.  Volume  I  contains  a  nontechnical  summary  of 
Phase  II,  including  guidelitnes  for  manacement  decisions  and  recommendations  for  the  future. 
Volume  II  describes  the  technical  approach,  findings  and  recommendations  of  the  study. 

Volume  III  presents  the  reduced  data,  in  the  form  of  frequency  distributions  and  models  for 
relationships  among  elements  of  the  flow  process. 
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